00000001:02000400:3.0F:1788201007.647563:0:3300:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788201024.936078:0:3521:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788201026.573355:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 583 MB/s 00000001:01000000:2.0F:1788201026.823283:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 799 MB/s 00000001:01000000:2.0:1788201027.077998:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3185 MB/s 00000020:02000000:3.0:1788201027.611350:0:3613:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_54_gb664824 00000400:02000000:3.0:1788201028.373089:0:3628:0:(api-ni.c:2822:lnet_startup_lndni()) Added LNI 192.168.203.102@tcp [8/256/0/180] 00008000:02000000:2.0:1788201031.989510:0:3778:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788201087.533278:0:5743:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788201100.283594:0:6493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201100.283603:0:6493:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788201100.283604:0:6493:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788201100.283851:0:6493:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000e85db24c 00000080:02000400:3.0:1788201100.283866:0:6493:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788201100.300369:0:6493:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788201100.300387:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788201100.300444:0:6493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006d641702) 00000020:00000080:3.0:1788201100.300470:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788201100.378101:0:6493:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788201100.378391:0:6493:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0F:1788201100.407675:0:6493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788201100.408694:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788201100.408705:0:6493:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201100.408720:0:6493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee4471fd52 00000020:01000004:1.0:1788201100.408728:0:6493:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788201100.408734:0:6493:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788201100.408980:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e85db24c from MGS 00000020:01000004:1.0:1788201100.408987:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788201100.409011:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000083b6fc2c) 00000020:00000080:1.0:1788201100.409025:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788201100.409342:0:6493:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e85db24c from MGS, refs=2 00080000:01000000:1.0:1788201100.409349:0:6493:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201100.409355:0:6493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee4471fd60 00000100:00100000:1.0:1788201100.409494:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788201100.409632:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788201100.409640:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788201100.410663:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788201100.410674:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788201100.411509:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201100.411694:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788201100.411700:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788201100.412679:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788201100.412689:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788201100.413280:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788201100.413288:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788201100.414184:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201100.414190:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201100.414457:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201100.416697:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201100.416704:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201100.416707:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201100.423259:0:6493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788201100.426486:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788201100.672815:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2751 MB/s 00000001:01000000:2.0:1788201100.922823:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4719 MB/s 00000001:01000000:0.0:1788201101.173302:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 483 MB/s 00000001:01000000:2.0:1788201101.423150:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 683 MB/s 00010000:00010000:0.0:1788201101.429912:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788201101.432455:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1788201101.443996:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788201101.451978:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788201101.452065:0:6493:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788201101.452145:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788201101.452435:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788201101.452469:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788201101.452857:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201101.453049:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788201101.453058:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788201101.455807:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788201101.455825:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788201101.461768:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788201101.461787:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788201101.462777:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788201101.462804:0:6493:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.102@tcp' 00000020:01000004:2.0:1788201101.462807:0:6493:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788201101.462866:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.102@tcp (typ=mgc) 00000020:00000080:2.0:1788201101.462891:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.102@tcp (00000000ac9c64cf) 00000020:00000080:2.0:1788201101.462923:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788201101.463083:0:6493:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000010f88e8a@MGC192.168.203.102@tcp: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1788201101.463273:0:6493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.102@tcp-0 is initialized 00000040:01000000:2.0:1788201101.463281:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788201101.464575:0:6513:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788201101.464623:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.102@tcp (uuid c49adc14-d6d0-415b-83c4-8895eee6f8a8) 00000020:00000080:1.0:1788201101.464651:0:6493:0:(genops.c:1406:class_connect()) connect: client c49adc14-d6d0-415b-83c4-8895eee6f8a8, cookie 0xf9b71aee4471fd6e 00000100:00080000:1.0:1788201101.464666:0:6493:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201101.464673:0:6493:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import 0000000010f88e8a using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201101.464725:0:6493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b5c8bd00 x1875064681136256/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201101.464776:0:6493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS 00000020:01000004:1.0:1788201101.464796:0:6493:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788201101.464830:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788201101.464845:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b9c77362) 00000020:00000080:1.0:1788201101.464857:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1788201101.466873:0:6512:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788201101.467230:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b5c8bd00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3643:1875064681136256:0@lo:250: 00000100:00100000:3.0:1788201101.467295:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201101.467370:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681136256 00000100:00100000:3.0:1788201101.467379:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681136256 00000100:00100000:3.0:1788201101.467427:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201101.467435:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099732812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875064681136256:12345-0@lo:250: 00010000:00080000:3.0:1788201101.467467:0:6509:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from c49adc14-d6d0-415b-83c4-8895eee6f8a8@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:3.0:1788201101.467499:0:6509:0:(genops.c:1406:class_connect()) connect: client c49adc14-d6d0-415b-83c4-8895eee6f8a8, cookie 0xf9b71aee4471fd7c 00000100:00080000:3.0:1788201101.467995:0:6509:0:(import.c:65:import_set_state_nolock()) 0000000021a821b1 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201101.468367:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099732812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:3643:x1875064681136256:12345-0@lo:250: Request processed in 930us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.468378:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201101.468454:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788201101.468472:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.102@tcp: connect to target with instance 0 00000100:00080000:3.0:1788201101.468482:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788201101.468489:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788201101.468492:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000010f88e8a MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788201101.468495:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788201101.468507:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201101.468512:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b5c8bd00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3643:1875064681136256:0@lo:250: 00000100:00100000:1.0:1788201101.487575:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201101.488042:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201101.488050:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788201101.491533:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788201101.491624:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788201101.496247:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201101.496265:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788201101.498689:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201101.498930:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788201101.498938:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788201101.504461:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788201101.504481:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788201101.549173:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201101.549434:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788201101.549442:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788201101.552873:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788201101.552905:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788201101.553960:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201101.554166:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201101.554173:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788201101.555092:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201101.555102:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788201101.555697:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201101.556223:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201101.556230:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788201101.558034:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201101.558053:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788201101.558827:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201101.559015:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788201101.559020:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788201101.566734:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201101.566813:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788201101.589718:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201101.590009:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201101.590017:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788201101.592846:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201101.592870:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788201101.593731:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201101.593791:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788201101.601366:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788201101.601430:0:6493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788201101.601438:0:6493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788201101.602054:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201101.602384:0:6493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788201101.606212:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201101.606215:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201101.606217:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201101.606218:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201101.606219:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201101.606220:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201101.606222:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201101.606223:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201101.606225:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201101.606226:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201101.606227:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201101.606229:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201101.606234:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788201101.606237:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201101.606238:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201101.606262:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201101.606263:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201101.606264:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201101.606265:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201101.606266:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201101.606267:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201101.606268:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201101.606269:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201101.606270:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201101.606271:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201101.606330:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788201101.606356:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000017c99246 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136384:0@lo:253: 00000100:00100000:0.0:1788201101.606484:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.607277:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000000eb3278 going to sleep for 11 seconds 00000100:00100000:1.0:1788201101.607292:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681136384 00000100:00100000:1.0:1788201101.607303:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681136384 00000100:00100000:1.0:1788201101.607355:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201101.607364:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d60f0755 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:6493:x1875064681136384:12345-0@lo:253: 20000000:01000000:1.0:1788201101.607440:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201101.607448:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788201101.607828:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788201101.607912:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788201101.608267:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201101.613244:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788201101.615788:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201101.615797:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788201101.615805:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788201101.615809:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788201101.615825:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788201101.616601:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201101.616846:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788201101.616863:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788201101.616883:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788201101.616912:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788201101.616931:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788201101.617107:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788201101.617117:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788201101.617130:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788201101.617135:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788201101.617146:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788201101.617151:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788201101.617370:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788201101.617404:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788201101.617437:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788201101.617443:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788201101.617450:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201101.617627:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788201101.617637:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788201101.617652:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788201101.617665:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788201101.617677:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788201101.617686:0:6511:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788201101.617711:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788201101.617718:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788201101.617731:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788201101.617804:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788201101.617819:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788201101.617828:0:6511:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788201101.617851:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788201101.617858:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788201101.617868:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788201101.617879:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788201101.618085:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788201101.618112:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788201101.618119:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788201101.621038:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788201101.621494:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788201101.621530:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.102@tcp for mdt 20000000:01000000:2.0:1788201101.621533:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:2.0:1788201101.621556:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788201101.621563:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788201101.621795:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788201101.621809:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:2.0:1788201101.621824:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788201101.621836:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788201101.621855:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788201101.622516:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788201101.622575:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788201101.622579:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788201101.622585:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788201101.623164:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788201101.623168:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788201101.624272:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788201101.624845:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788201101.624875:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788201101.624890:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788201101.624902:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788201101.624904:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788201101.625289:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788201101.625468:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788201101.625490:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788201101.625506:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788201101.625521:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201101.625524:0:6511:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788201101.625529:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788201101.625531:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788201101.625538:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788201101.625546:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788201101.630897:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788201101.631184:0:6511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788201101.653557:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788201101.653607:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788201101.653634:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788201101.653666:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788201101.654900:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.654928:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.654940:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.654970:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.654977:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.654984:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.654991:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d38edc5c already unused, calling callback (00000000fc0d9d7c) 00010000:00010000:3.0:1788201101.654995:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.655004:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.655019:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.655027:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.655032:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd83 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201101.655182:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788201101.676170:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d60f0755 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:6493:x1875064681136384:12345-0@lo:253: Request processed in 68786us (69666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.676196:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201101.676487:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000017c99246 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136384:0@lo:253: 10000000:01000000:0.0:1788201101.676506:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788201101.676510:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201101.676513:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201101.676514:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201101.676515:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788201101.676516:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201101.676518:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201101.676519:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201101.676521:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201101.676522:0:6493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788201101.676524:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201101.676526:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201101.676552:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e85db24c from lustre-MDT0000 10000000:01000000:0.0:1788201101.676590:0:6493:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788201101.676594:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788201101.676599:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ce0b2520000 10000000:01000000:0.0:1788201101.676605:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201101.676615:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ce0b2520000 from 1 10000000:01000000:0.0:1788201101.676637:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788201101.677404:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.677423:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.677434:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201101.677463:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000017c99246 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136512:0@lo:101: 00000100:00100000:0.0:1788201101.677525:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.677609:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f4fc959 going to sleep for 11 seconds 00000100:00100000:3.0:1788201101.677871:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681136512 00000100:00100000:3.0:1788201101.677892:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681136512 00000100:00100000:3.0:1788201101.677951:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201101.677960:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b17504e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:6493:x1875064681136512:12345-0@lo:101: 00010000:00010000:3.0:1788201101.677977:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201101.677993:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fd8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.678020:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.678031:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.678041:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d38edc5c, rc 0) 00000100:00100000:3.0:1788201101.678094:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b17504e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:6493:x1875064681136512:12345-0@lo:101: Request processed in 136us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.678101:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201101.678212:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000017c99246 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136512:0@lo:101: 00010000:00010000:1.0:1788201101.678230:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.678240:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201101.678307:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136640:0@lo:501: 00000100:00100000:1.0:1788201101.678337:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.678418:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000422ef7b3 going to sleep for 11 seconds 00000100:00100000:3.0:1788201101.679270:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681136640 00000100:00100000:3.0:1788201101.679281:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681136640 00000100:00100000:2.0:1788201101.679479:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201101.679488:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b80f8d78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:6493:x1875064681136640:12345-0@lo:501: 00000100:00100000:2.0:1788201101.679660:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b80f8d78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:6493:x1875064681136640:12345-0@lo:501: Request processed in 173us (1323us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201101.679668:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201101.679784:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136640:0@lo:501: 10000000:01000000:1.0:1788201101.679833:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201101.679863:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.679874:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201101.679885:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0889be000 10000000:01000000:1.0:1788201101.679890:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201101.679895:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ce0889be000 10000000:01000000:1.0:1788201101.679897:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788201101.679900:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ce0889be000 from 1 10000000:01000000:1.0:1788201101.679903:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201101.679949:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000766bff48/0xf9b71aee4471fd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.679957:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000766bff48/0xf9b71aee4471fd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.679966:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000766bff48/0xf9b71aee4471fd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201101.679986:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136768:0@lo:101: 00000100:00100000:1.0:1788201101.680027:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.680765:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000422ef7b3 going to sleep for 11 seconds 00000100:00100000:3.0:1788201101.680983:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681136768 00000100:00100000:3.0:1788201101.680991:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681136768 00000100:00100000:3.0:1788201101.681036:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201101.681044:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000050089b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:6493:x1875064681136768:12345-0@lo:101: 00010000:00010000:3.0:1788201101.681059:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201101.681078:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000411a7a9e/0xf9b71aee4471fd9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fd98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.681115:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000411a7a9e/0xf9b71aee4471fd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fd98 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.681143:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000411a7a9e/0xf9b71aee4471fd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fd98 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.681152:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000411a7a9e, rc 0) 00000100:00100000:3.0:1788201101.681208:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000050089b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+7:6493:x1875064681136768:12345-0@lo:101: Request processed in 165us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.681215:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201101.681328:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136768:0@lo:101: 00010000:00010000:1.0:1788201101.681345:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000766bff48/0xf9b71aee4471fd98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.681354:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000766bff48/0xf9b71aee4471fd98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201101.681383:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788201101.681406:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000766bff48/0xf9b71aee4471fd98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.681413:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000766bff48/0xf9b71aee4471fd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201101.681421:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201101.681425:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201101.681432:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ce0889be000 10000000:01000000:1.0:1788201101.681434:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201101.681438:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788201101.681441:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201101.681461:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.681467:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.681475:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201101.681506:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136896:0@lo:101: 00000100:00100000:1.0:1788201101.681540:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.681562:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000422ef7b3 going to sleep for 11 seconds 00000100:00100000:3.0:1788201101.681713:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681136896 00000100:00100000:3.0:1788201101.681718:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681136896 00000100:00100000:3.0:1788201101.681767:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201101.681774:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cb4bdbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+7:6493:x1875064681136896:12345-0@lo:101: 00010000:00010000:3.0:1788201101.681781:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201101.681789:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fda6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.681803:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.681811:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.681817:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c8d0bcc8, rc 0) 00000100:00100000:3.0:1788201101.681852:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cb4bdbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+8:6493:x1875064681136896:12345-0@lo:101: Request processed in 80us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.681859:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201101.682042:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681136896:0@lo:101: 00010000:00010000:1.0:1788201101.682054:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.682073:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201101.682139:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137024:0@lo:501: 00000100:00100000:1.0:1788201101.682164:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.682191:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000422ef7b3 going to sleep for 11 seconds 00000100:00100000:3.0:1788201101.683397:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681137024 00000100:00100000:3.0:1788201101.683411:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681137024 00000100:00100000:3.0:1788201101.683458:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201101.683479:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006227933a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+8:6493:x1875064681137024:12345-0@lo:501: 00000100:00100000:3.0:1788201101.683770:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006227933a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:6493:x1875064681137024:12345-0@lo:501: Request processed in 291us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.683777:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201101.684712:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137024:0@lo:501: 00000100:00100000:1.0:1788201101.684802:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137152:0@lo:503: 00000100:00100000:1.0:1788201101.684978:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.685071:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000422ef7b3 going to sleep for 11 seconds 00000100:00100000:0.0:1788201101.685123:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681137152 00000100:00100000:0.0:1788201101.685131:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681137152 00000100:00100000:0.0:1788201101.685192:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201101.685202:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b8157aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:6493:x1875064681137152:12345-0@lo:503: 00000100:00100000:1.0:1788201101.685908:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137152:0@lo:503: 00000100:00100000:0.0:1788201101.685991:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b8157aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:6493:x1875064681137152:12345-0@lo:503: Request processed in 790us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.686000:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201101.687097:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026a6833d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6537:1875064681137280:0@lo:502: 00000100:00100000:2.0:1788201101.687172:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201101.687351:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681137280 00000100:00100000:3.0:1788201101.687359:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681137280 00000100:00100000:3.0:1788201101.687420:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201101.687429:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e526443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:6537:x1875064681137280:12345-0@lo:502: 00000100:00100000:3.0:1788201101.687684:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e526443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:6537:x1875064681137280:12345-0@lo:502: Request processed in 257us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.687691:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201101.687789:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d7d2c3b2 going to sleep for 11 seconds 00000100:00100000:2.0:1788201101.687815:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026a6833d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6537:1875064681137280:0@lo:502: 00000020:01000000:2.0:1788201101.687848:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201101.687863:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201101.687866:0:6537:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201101.687872:0:6537:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788201101.687877:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201101.687895:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000077b7f603) 00000020:00000080:2.0:1788201101.687920:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788201101.687928:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788201101.688203:0:6537:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788201101.688214:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee4471fdbb 00000020:00000080:2.0:1788201101.688877:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788201101.688885:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201101.688889:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201101.688891:0:6537:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201101.688894:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201101.688898:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201101.688904:0:6537:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788201101.688908:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201101.688917:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f55c8494) 00000020:00000080:2.0:1788201101.688931:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788201101.688936:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788201101.688937:0:6537:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788201101.688941:0:6537:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788201101.688948:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201101.689007:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e85db24c from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788201101.689021:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b61ad258) 00000020:00000080:2.0:1788201101.689039:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788201101.689123:0:6537:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788201101.689129:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee4471fdd0 00000020:00000080:2.0:1788201101.691435:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788201101.691471:0:6537:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788201101.691708:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf9b71aee4471fdd7 00080000:01000000:2.0:1788201101.691722:0:6537:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788201101.691727:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee4471fdde 00080000:10000000:2.0:1788201101.693295:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788201101.694155:0:6537:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788201101.708926:0:6537:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788201101.814713:0:6537:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788201101.815181:0:6537:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788201101.826305:0:6537:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788201101.827320:0:6537:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788201101.832041:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000049984488) 00000020:00000080:1.0:1788201101.832073:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788201101.832175:0:6537:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788201101.832997:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee4471fdec 00000020:00000080:1.0:1788201101.838017:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788201101.843037:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788201101.847219:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788201101.852088:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788201101.857372:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788201101.867712:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788201101.872517:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788201101.875631:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf9b71aee4471fdf3 00000020:00000080:3.0:1788201101.876353:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788201101.876370:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201101.876378:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201101.876381:0:6537:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788201101.876394:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201101.876401:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201101.876403:0:6537:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201101.876406:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201101.876407:0:6537:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201101.876410:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201101.876412:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201101.876413:0:6537:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201101.876415:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201101.876420:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201101.876427:0:6537:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788201101.876431:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788201101.876475:0:6537:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788201101.876559:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019b8a735 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6537:1875064681137408:0@lo:502: 00000100:00100000:3.0:1788201101.876652:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201101.876935:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aeae927f going to sleep for 11 seconds 00000100:00100000:1.0:1788201101.877308:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681137408 00000100:00100000:1.0:1788201101.877318:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681137408 00000100:00100000:1.0:1788201101.877410:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201101.877419:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c0fb107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:6537:x1875064681137408:12345-0@lo:502: 00000100:00100000:1.0:1788201101.877593:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c0fb107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:6537:x1875064681137408:12345-0@lo:502: Request processed in 166us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201101.877601:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201101.877700:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019b8a735 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6537:1875064681137408:0@lo:502: 00000020:01000000:2.0:1788201101.877765:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201101.877773:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201101.877775:0:6537:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788201101.877779:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788201101.881054:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788201101.881100:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201101.881128:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.881144:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201101.881153:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0889be000 from 1 10000000:01000000:0.0:1788201101.881156:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201101.881248:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.881257:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.881268:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201101.881296:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137536:0@lo:101: 00000100:00100000:0.0:1788201101.881396:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.881496:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000019ef31b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788201101.881916:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681137536 00000100:00100000:1.0:1788201101.881928:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681137536 00000100:00100000:1.0:1788201101.881987:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201101.881998:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000288e88d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:6493:x1875064681137536:12345-0@lo:101: 00010000:00010000:1.0:1788201101.882016:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201101.882035:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fdfa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.882065:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.882076:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.882085:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6e53c57, rc 0) 00000100:00100000:1.0:1788201101.882144:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000288e88d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:6493:x1875064681137536:12345-0@lo:101: Request processed in 148us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201101.882152:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201101.882325:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137536:0@lo:101: 00010000:00010000:0.0:1788201101.882342:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.882353:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201101.883063:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137664:0@lo:256: 00000100:00100000:0.0:1788201101.883119:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.883166:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000019ef31b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788201101.883313:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681137664 00000100:00100000:1.0:1788201101.883321:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681137664 00000100:00100000:1.0:1788201101.883352:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201101.883358:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e7b8bce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:6493:x1875064681137664:12345-0@lo:256: 20000000:01000000:1.0:1788201101.883378:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788201101.883384:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788201101.883472:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e7b8bce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:6493:x1875064681137664:12345-0@lo:256: Request processed in 114us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201101.883480:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201101.883618:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137664:0@lo:256: 10000000:01000000:0.0:1788201101.885024:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201101.885082:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.885098:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201101.885124:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0889be000 from 1 10000000:01000000:0.0:1788201101.885128:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201101.885170:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.885199:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.885210:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201101.885234:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137792:0@lo:101: 00000100:00100000:0.0:1788201101.885298:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.885344:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000019ef31b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788201101.885477:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681137792 00000100:00100000:1.0:1788201101.885487:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681137792 00000100:00100000:1.0:1788201101.885550:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201101.885559:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a4ded6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:6493:x1875064681137792:12345-0@lo:101: 00010000:00010000:1.0:1788201101.885575:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201101.885589:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fe08 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.885614:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.885624:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.885634:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9259932, rc 0) 00000100:00100000:1.0:1788201101.885680:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a4ded6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:6493:x1875064681137792:12345-0@lo:101: Request processed in 123us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201101.885697:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201101.886358:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137792:0@lo:101: 00010000:00010000:0.0:1788201101.886380:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.886401:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201101.886485:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137920:0@lo:501: 00000100:00100000:0.0:1788201101.886522:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.886564:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000019ef31b6 going to sleep for 11 seconds 00000100:00100000:2.0:1788201101.886716:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681137920 00000100:00100000:2.0:1788201101.886723:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681137920 00000100:00100000:2.0:1788201101.886775:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201101.886785:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008db61367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:6493:x1875064681137920:12345-0@lo:501: 00000100:00100000:2.0:1788201101.886981:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008db61367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:6493:x1875064681137920:12345-0@lo:501: Request processed in 197us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201101.886989:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201101.887666:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681137920:0@lo:501: 00000100:00100000:0.0:1788201101.887725:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138048:0@lo:503: 00000100:00100000:0.0:1788201101.887892:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.887926:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000019ef31b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788201101.888071:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681138048 00000100:00100000:1.0:1788201101.888077:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681138048 00000100:00100000:1.0:1788201101.888104:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201101.888110:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a450ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:6493:x1875064681138048:12345-0@lo:503: 00000040:00080000:1.0:1788201101.888150:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201101.888442:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a450ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:6493:x1875064681138048:12345-0@lo:503: Request processed in 332us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201101.888450:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201101.889198:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138048:0@lo:503: 00000040:00080000:0.0:1788201101.891548:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788201101.892036:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788201101.892064:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201101.892085:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.892124:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201101.892192:0:6493:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201101.892196:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0889be000 10000000:01000000:1.0:1788201101.892199:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0889be000 10000000:01000000:1.0:1788201101.892205:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201101.892212:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0889be000 from 1 10000000:01000000:1.0:1788201101.892215:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201101.892259:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.892267:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.892277:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201101.892302:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138176:0@lo:101: 00000100:00100000:1.0:1788201101.892381:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.892446:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007a6e2dc going to sleep for 11 seconds 00000100:00100000:0.0:1788201101.892578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681138176 00000100:00100000:0.0:1788201101.892588:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681138176 00000100:00100000:0.0:1788201101.892641:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201101.892650:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d6b128b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:6493:x1875064681138176:12345-0@lo:101: 00010000:00010000:0.0:1788201101.892668:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201101.892683:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fe16 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.892712:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.892725:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.892734:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099c1d427, rc 0) 00000100:00100000:0.0:1788201101.892804:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d6b128b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6493:x1875064681138176:12345-0@lo:101: Request processed in 155us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.892822:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201101.893115:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138176:0@lo:101: 00010000:00010000:1.0:1788201101.893135:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.893145:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201101.893234:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138304:0@lo:501: 00000100:00100000:1.0:1788201101.893262:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.893296:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007a6e2dc going to sleep for 11 seconds 00000100:00100000:3.0:1788201101.893347:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681138304 00000100:00100000:3.0:1788201101.893352:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681138304 00000100:00100000:3.0:1788201101.893395:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201101.893403:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dd3b24c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6493:x1875064681138304:12345-0@lo:501: 00000100:00100000:3.0:1788201101.893549:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dd3b24c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6493:x1875064681138304:12345-0@lo:501: Request processed in 146us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.893556:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201101.893701:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138304:0@lo:501: 00000100:00100000:1.0:1788201101.893729:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138432:0@lo:503: 00000100:00100000:1.0:1788201101.893803:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.894340:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007a6e2dc going to sleep for 11 seconds 00000100:00100000:3.0:1788201101.894410:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681138432 00000100:00100000:3.0:1788201101.894415:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681138432 00000100:00100000:3.0:1788201101.894454:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201101.894460:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbc42fe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6493:x1875064681138432:12345-0@lo:503: 00000100:00100000:3.0:1788201101.894571:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbc42fe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6493:x1875064681138432:12345-0@lo:503: Request processed in 111us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.894577:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201101.894683:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138432:0@lo:503: 00000100:00100000:1.0:1788201101.895369:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6542:1875064681138560:0@lo:502: 00000100:00100000:1.0:1788201101.895431:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.895469:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b43286b going to sleep for 11 seconds 00000100:00100000:0.0:1788201101.895523:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681138560 00000100:00100000:0.0:1788201101.895530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681138560 00000100:00100000:0.0:1788201101.895566:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201101.895573:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010cf90cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6542:x1875064681138560:12345-0@lo:502: 00000100:00100000:0.0:1788201101.895681:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010cf90cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6542:x1875064681138560:12345-0@lo:502: Request processed in 108us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.895697:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201101.895881:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6542:1875064681138560:0@lo:502: 00000020:01000004:1.0:1788201101.895950:0:6542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788201101.895969:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000094e6152) 00000020:00000080:1.0:1788201101.895993:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788201101.896410:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e85db24c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201101.896415:0:6542:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e85db24c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201101.896418:0:6542:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e85db24c 4 00010000:00080000:1.0:1788201101.896453:0:6542:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000005648fe5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201101.905413:0:6542:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788201101.905541:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788201101.905592:0:6542:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201101.905609:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf9b71aee4471fe2b 00000100:00080000:1.0:1788201101.905623:0:6542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201101.905629:0:6542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000005648fe5 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201101.905685:0:6542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c2ceffd9 x1875064681138688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201101.905783:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681138688:0@lo:38: 00000100:00100000:3.0:1788201101.907284:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201101.907476:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681138688 00000100:00100000:2.0:1788201101.907489:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681138688 00000100:00100000:2.0:1788201101.907537:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201101.907545:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ecb1965 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681138688:12345-0@lo:38: 00000100:00080000:1.0:1788201101.908038:0:6542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788201101.908462:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003625543c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6542:1875064681138816:0@lo:502: 00000100:00100000:1.0:1788201101.908531:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.908571:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b43286b going to sleep for 11 seconds 00000100:00100000:0.0:1788201101.908802:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681138816 00000100:00100000:0.0:1788201101.908818:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681138816 00000100:00100000:0.0:1788201101.908859:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201101.908866:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed96d827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6542:x1875064681138816:12345-0@lo:502: 00000100:00100000:0.0:1788201101.908995:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed96d827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6542:x1875064681138816:12345-0@lo:502: Request processed in 129us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.909101:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201101.909351:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003625543c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6542:1875064681138816:0@lo:502: 00000040:00080000:1.0:1788201101.909395:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788201101.909539:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788201101.909563:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201101.909581:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.909592:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201101.909639:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201101.909642:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201101.909643:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201101.909644:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201101.909645:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201101.909647:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201101.909648:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201101.909649:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201101.909651:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201101.909651:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201101.909653:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201101.909654:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201101.909657:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788201101.909660:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201101.909661:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201101.909661:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201101.909666:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201101.909667:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201101.909668:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201101.909669:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201101.909670:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201101.909671:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201101.909671:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201101.909672:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201101.909673:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201101.909696:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788201101.909709:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138944:0@lo:253: 00000100:00100000:0.0:1788201101.909772:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.909802:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e10b46d5 going to sleep for 11 seconds 00000100:00100000:2.0:1788201101.909844:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ecb1965 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681138688:12345-0@lo:38: Request processed in 2298us (3834us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201101.909855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201101.909996:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201101.910006:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000005648fe5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201101.910479:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201101.910484:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2ceffd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681138688:0@lo:38: 00000100:00100000:3.0:1788201101.910549:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681138944 00000100:00100000:3.0:1788201101.910564:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681138944 00000100:00100000:3.0:1788201101.910647:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201101.910656:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2fe2b52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6493:x1875064681138944:12345-0@lo:253: 20000000:01000000:3.0:1788201101.910687:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201101.910702:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788201101.926445:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201101.926473:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788201101.926648:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201101.926654:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201101.926681:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.926714:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.926722:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.926812:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.926832:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 12 pid: 6509 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201101.926850:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026a6833d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681139072:0@lo:104: 00000100:00100000:2.0:1788201101.926933:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201101.926999:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dfea6f60 going to sleep for 11 seconds 00000100:00100000:3.0:1788201101.927480:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681139072 00000100:00100000:3.0:1788201101.927490:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681139072 00000100:00100000:3.0:1788201101.927554:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201101.927564:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9982e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6531:x1875064681139072:12345-0@lo:104: 00010000:00010000:3.0:1788201101.927581:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201101.927659:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201101.927665:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9982e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6531:x1875064681139072:12345-0@lo:104: Request processed in 103us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.927672:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788201101.927884:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201101.927891:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.927899:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000194bfa74 already unused, calling callback (00000000ee5bf388) 10000000:00010000:1.0:1788201101.927903:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.927912:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201101.927918:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201101.927923:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201101.927966:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.927973:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201101.927994:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201101.928144:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201101.928156:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003625543c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681139200:0@lo:103: 00000100:00100000:3.0:1788201101.928221:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.928491:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2fe2b52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6493:x1875064681138944:12345-0@lo:253: Request processed in 17836us (18718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.928502:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201101.928642:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000426c30bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6493:1875064681138944:0@lo:253: 10000000:01000000:3.0:1788201101.928657:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788201101.928660:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201101.928662:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201101.928663:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201101.928664:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201101.928665:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201101.928667:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201101.928668:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201101.928676:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201101.928678:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201101.928679:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201101.928681:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201101.928682:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788201101.928699:0:6493:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788201101.929103:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 00000000194bfa74/0xf9b71aee4471fdfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe01 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.929122:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201101.929124:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201101.929126:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201101.929145:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681139200 00000100:00100000:1.0:1788201101.929152:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681139200 00010000:00010000:1.0:1788201101.929176:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 12 pid: 6509 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201101.930110:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201101.930124:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b53c8b74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:3644:x1875064681139200:12345-0@lo:103: 00010000:00010000:1.0:1788201101.930141:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201101.930147:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 12 pid: 6509 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930159:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 12 pid: 6509 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930296:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930306:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201101.930324:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003671023s 00010000:00010000:1.0:1788201101.930328:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930347:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930354:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930360:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930367:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000064a226af already unused, calling callback (00000000fc0d9d7c) 00010000:00010000:1.0:1788201101.930370:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930378:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930396:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930407:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201101.930476:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b53c8b74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:3644:x1875064681139200:12345-0@lo:103: Request processed in 357us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201101.930484:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788201101.930529:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d6e53c57/0xf9b71aee4471fe01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fdfa expref: 11 pid: 6509 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201101.930541:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026a6833d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681139072:0@lo:104: 00010000:00010000:1.0:1788201101.930562:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930581:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930586:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201101.930591:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064a226af/0xf9b71aee4471fe32 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201101.932603:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003625543c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681139200:0@lo:103: 00080000:10000000:3.0:1788201101.939129:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788201101.939306:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788201101.939523:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788201101.939669:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788201101.939878:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788201101.940020:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788201101.946477:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788201101.946662:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788201101.947172:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788201101.947418:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788201101.947617:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788201101.948165:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788201101.954493:0:6493:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788201101.963056:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788201101.963328:0:6548:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788201101.964682:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:2.0:1788201101.965035:0:6547:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788201101.965042:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788201101.965150:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788201101.965707:0:6493:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788201101.965716:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788201101.965879:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201101.967045:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788201101.967997:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788201101.968051:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788201101.968581:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201101.970669:0:6548:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788201101.971311:0:6493:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1788201101.975735:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788201101.976080:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788201101.976317:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788201101.976469:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788201101.976612:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000040:00080000:0.0:1788201101.977685:0:6548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:3.0:1788201101.977893:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788201101.978171:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788201101.978368:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788201101.978513:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000004:00080000:0.0:1788201101.979025:0:6548:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788201101.979031:0:6548:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788201101.979598:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788201101.979932:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788201101.980071:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788201101.980312:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788201101.980490:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788201101.980630:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788201101.980924:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788201101.981304:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788201101.982322:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788201101.982507:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788201101.982631:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788201101.983057:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788201101.983287:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788201101.983439:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788201101.983581:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788201101.983711:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788201101.984087:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788201101.984305:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788201101.984454:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788201101.984584:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788201101.985009:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788201101.985162:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788201101.985377:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788201101.985650:0:6493:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788201101.993985:0:6493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788201101.994100:0:6493:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc15181c43988 00100000:10000000:2.0:1788201101.994111:0:6493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788201101.995181:0:6493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201101.995201:0:6493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201101.995230:0:6493:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788201101.995263:0:6493:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788201101.996051:0:6493:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201101.996242:0:6493:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788201102.455345:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201103.484577:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201104.502923:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201105.527498:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201105.812872:0:6793:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788201106.553166:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201106.704990:0:6845:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201106.705177:0:6845:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1788201107.062339:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201107.062363:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201107.062367:0:37:0:(import.c:65:import_set_state_nolock()) 0000000005648fe5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201107.062387:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000005648fe5 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201107.062418:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005c82e8d9 x1875064681139456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201107.062470:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c82e8d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681139456:0@lo:38: 00000100:00100000:2.0:1788201107.062559:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201107.062805:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ceec3805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681139328:0@lo:400: 00000100:00100000:1.0:1788201107.062846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201107.063465:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681139328 00000100:00100000:2.0:1788201107.063477:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681139328 00000100:00100000:2.0:1788201107.063587:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201107.063597:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eb96123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:3646:x1875064681139328:12345-0@lo:400: 00000100:00100000:3.0:1788201107.063648:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681139456 00000100:00100000:3.0:1788201107.063655:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681139456 00000100:00100000:2.0:1788201107.063669:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eb96123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:3646:x1875064681139328:12345-0@lo:400: Request processed in 73us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201107.063677:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201107.063686:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201107.063693:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c19a55f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681139456:12345-0@lo:38: 00010000:00080000:3.0:1788201107.063721:0:6517:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1788201107.063779:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf9b71aee4471fe39 00000004:00100000:3.0:1788201107.063824:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201107.064256:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000ba909e15 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201107.064319:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c19a55f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875064681139456:12345-0@lo:38: Request processed in 626us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201107.064328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201107.066576:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ceec3805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681139328:0@lo:400: 00010000:00080000:2.0:1788201107.066778:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005c82e8d9 x1875064681139456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201107.066800:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788201107.066810:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788201107.066816:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201107.066820:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000005648fe5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201107.066827:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c82e8d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681139456:0@lo:38: 00010000:00010000:0.0:1788201107.576941:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201108.599307:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201109.252876:0:6946:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201109.253213:0:6946:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201109.622437:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201110.649658:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788201111.157883:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201111.157891:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0889be000 from 3 10000000:01000000:3.0:1788201111.157905:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201111.157954:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.157966:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.157978:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201111.158000:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681139584:0@lo:101: 00000100:00100000:3.0:1788201111.158069:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201111.158131:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 0000000053eeca14 going to sleep for 11 seconds 00000100:00100000:3.0:1788201111.161123:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681139584 00000100:00100000:3.0:1788201111.161140:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681139584 00000100:00100000:3.0:1788201111.161203:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201111.161226:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b25d658 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:6513:x1875064681139584:12345-0@lo:101: 00010000:00010000:3.0:1788201111.161251:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201111.161272:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fe40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.161301:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.161313:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.161334:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e7b4cba4, rc 0) 00000100:00100000:3.0:1788201111.161419:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b25d658 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6513:x1875064681139584:12345-0@lo:101: Request processed in 194us (3350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201111.161426:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201111.161485:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681139584:0@lo:101: 00010000:00010000:3.0:1788201111.161505:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.161516:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201111.161587:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681139712:0@lo:256: 00000100:00100000:3.0:1788201111.161625:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201111.163635:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681139712 00000100:00100000:0.0:1788201111.163666:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681139712 00000100:00100000:0.0:1788201111.163731:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201111.163772:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068565bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6513:x1875064681139712:12345-0@lo:256: 20000000:01000000:0.0:1788201111.163891:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201111.163914:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201111.163917:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788201111.164298:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068565bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:6513:x1875064681139712:12345-0@lo:256: Request processed in 559us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.164307:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201111.176430:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 0000000053eeca14 going to sleep for 11 seconds 00000100:00100000:3.0:1788201111.176659:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681139712:0@lo:256: 10000000:01000000:3.0:1788201111.176730:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201111.176815:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.176837:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201111.672909:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201112.182204:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084c9f780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681139840:0@lo:400: 00000100:00100000:3.0:1788201112.182289:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201112.182516:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681139840 00000100:00100000:0.0:1788201112.182525:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681139840 00000100:00100000:0.0:1788201112.182589:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201112.182598:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce847e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:3647:x1875064681139840:12345-0@lo:400: 00000100:00100000:1.0:1788201112.182773:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009aebce42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681139968:0@lo:400: 00000100:00100000:1.0:1788201112.182813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201112.182880:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681139968 00000100:00100000:1.0:1788201112.182884:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681139968 00000100:00100000:1.0:1788201112.182913:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201112.182920:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aed9204b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681139968:12345-0@lo:400: 00000100:00100000:1.0:1788201112.182957:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aed9204b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681139968:12345-0@lo:400: Request processed in 38us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201112.182978:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201112.183017:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009aebce42 x1875064681139968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201112.183032:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009aebce42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681139968:0@lo:400: 00000100:00100000:0.0:1788201112.186093:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce847e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:3647:x1875064681139840:12345-0@lo:400: Request processed in 3488us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201112.187403:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201112.187921:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084c9f780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681139840:0@lo:400: 00010000:00010000:0.0:1788201112.695235:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201113.721184:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201114.742924:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201115.769708:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201116.789985:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201117.302707:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201117.302760:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681140224:0@lo:400: 00000100:00100000:1.0:1788201117.302936:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000187a248d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681140096:0@lo:400: 00000100:00100000:0.0:1788201117.302971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201117.302992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201117.303119:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681140224 00000100:00100000:2.0:1788201117.303130:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681140224 00000100:00100000:2.0:1788201117.303194:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201117.303203:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060baeda9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681140224:12345-0@lo:400: 00000100:00100000:2.0:1788201117.303269:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060baeda9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681140224:12345-0@lo:400: Request processed in 67us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201117.303292:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201117.303411:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681140096 00000100:00100000:1.0:1788201117.303415:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681140096 00000100:00100000:1.0:1788201117.303452:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201117.303459:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006904e993 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:3645:x1875064681140096:12345-0@lo:400: 00000100:00100000:1.0:1788201117.303496:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006904e993 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:3645:x1875064681140096:12345-0@lo:400: Request processed in 38us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201117.303503:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201117.303551:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000187a248d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681140096:0@lo:400: 00010000:00080000:0.0:1788201117.305043:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000099005e80 x1875064681140224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201117.305068:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681140224:0@lo:400: 00010000:00010000:0.0:1788201117.814210:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201118.838249:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201119.670517:0:7445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201119.670522:0:7445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788201119.670524:0:7445:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788201119.670784:0:7445:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000048251234 00000020:01000004:2.0:1788201119.670802:0:7445:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788201119.671080:0:7445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788201119.671104:0:7445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000004ac1d7a7) 00000020:00000080:2.0:1788201119.671123:0:7445:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201119.742848:0:7445:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788201119.742949:0:7445:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788201119.777701:0:7445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201119.777986:0:7445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788201119.777998:0:7445:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201119.778012:0:7445:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee4471fe55 00000020:01000004:3.0:1788201119.778020:0:7445:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788201119.778046:0:7445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201119.778049:0:7445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201119.778292:0:7445:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788201119.778327:0:7445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788201119.778332:0:7445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788201119.811576:0:7445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201119.811628:0:7445:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788201119.811637:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201119.811640:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201119.811641:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201119.811642:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201119.811643:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201119.811645:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201119.811647:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201119.811648:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201119.811650:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201119.811652:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201119.811653:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201119.811658:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788201119.811660:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201119.811661:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201119.811662:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201119.811663:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201119.811664:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201119.811665:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201119.811665:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201119.811666:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201119.811667:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201119.811668:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201119.811669:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201119.811702:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788201119.811725:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681140352:0@lo:253: 00000100:00100000:0.0:1788201119.811850:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201119.811908:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 0000000072cc6640 going to sleep for 11 seconds 00000100:00100000:2.0:1788201119.812036:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681140352 00000100:00100000:2.0:1788201119.812046:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681140352 00000100:00100000:2.0:1788201119.812153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201119.812163:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4d41d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681140352:12345-0@lo:253: 20000000:01000000:2.0:1788201119.812204:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788201119.812208:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788201119.812213:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788201119.812217:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788201119.812256:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788201119.812478:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201119.812608:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788201119.812623:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788201119.812640:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788201119.812664:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788201119.812678:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788201119.812775:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788201119.812784:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788201119.812796:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788201119.812802:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788201119.812812:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788201119.812816:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788201119.812825:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788201119.812837:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788201119.812946:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788201119.812954:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:2.0:1788201119.812964:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788201119.812969:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788201119.812979:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788201119.812983:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:2.0:1788201119.812995:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788201119.813000:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788201119.813010:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788201119.813022:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788201119.813030:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788201119.813116:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788201119.813125:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788201119.813135:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788201119.813149:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788201119.813162:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788201119.813166:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788201119.813178:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788201119.813196:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788201119.813200:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788201119.813229:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788201119.813237:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1788201119.815575:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788201119.817117:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788201119.817161:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.102@tcp for mdt 20000000:01000000:0.0:1788201119.817163:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788201119.817182:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788201119.817188:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788201119.817201:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788201119.817206:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:0.0:1788201119.817221:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788201119.817229:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788201119.817276:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788201119.817296:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788201119.817382:0:6511:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788201119.817394:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788201119.818372:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788201119.818630:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788201119.818655:0:6511:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.102@tcp for mdt 20000000:01000000:0.0:1788201119.818657:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788201119.818675:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788201119.818681:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788201119.818692:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788201119.818697:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:0.0:1788201119.818709:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788201119.818715:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788201119.818727:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788201119.819619:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788201119.819659:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788201119.819663:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788201119.819668:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788201119.820132:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788201119.820136:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788201119.820566:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788201119.820602:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788201119.820630:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788201119.821016:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788201119.821040:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788201119.821069:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788201119.821080:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788201119.821082:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788201119.821510:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788201119.821531:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788201119.821556:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788201119.821718:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788201119.821847:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788201119.821875:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788201119.821891:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788201119.821893:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788201119.822215:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788201119.822233:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788201119.822248:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788201119.822395:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788201119.822415:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788201119.822430:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788201119.822444:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788201119.822446:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788201119.822452:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788201119.822460:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788201119.822722:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788201119.822857:0:6511:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788201119.833456:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788201119.833499:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.833525:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.833532:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.833538:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.833547:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.833607:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.833627:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 12 pid: 6511 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201119.833645:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875064681140480:0@lo:104: 00000100:00100000:3.0:1788201119.833987:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201119.834107:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.834117:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 12 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201119.834150:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088797d4f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875064681140608:0@lo:104: 00000100:00100000:3.0:1788201119.834197:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201119.835538:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.835554:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 12 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201119.835565:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875064681140736:0@lo:104: 00000100:00100000:3.0:1788201119.835604:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201119.835666:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681140480 00000100:00100000:1.0:1788201119.835676:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681140480 00000100:00100000:1.0:1788201119.835720:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681140608 00000100:00100000:1.0:1788201119.835723:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681140608 00000100:00100000:1.0:1788201119.835761:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201119.835771:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fc6fb7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6511:x1875064681140480:12345-0@lo:104: 00010000:00010000:1.0:1788201119.835785:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201119.835842:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201119.835847:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fc6fb7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6511:x1875064681140480:12345-0@lo:104: Request processed in 78us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201119.835854:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201119.835872:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201119.835876:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c372a49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6511:x1875064681140608:12345-0@lo:104: 00010000:00010000:1.0:1788201119.835882:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201119.835910:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201119.835914:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c372a49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6511:x1875064681140608:12345-0@lo:104: Request processed in 38us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201119.835919:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788201119.835981:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201119.835987:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.835995:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000067b4d926 already unused, calling callback (00000000ee5bf388) 10000000:00010000:2.0:1788201119.835998:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836006:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201119.836012:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201119.836019:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201119.836067:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836074:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201119.836096:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836102:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 0000000067b4d926/0xf9b71aee4471fe16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836137:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201119.836139:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836145:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cfce3566 already unused, calling callback (00000000ee5bf388) 10000000:00010000:2.0:1788201119.836147:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836153:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201119.836159:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201119.836164:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201119.836176:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836181:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201119.836195:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836200:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 00000000cfce3566/0xf9b71aee4471fda6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fdad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836210:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201119.836211:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201119.836212:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201119.836219:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201119.836239:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c82e8d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681140864:0@lo:103: 00000100:00100000:2.0:1788201119.836292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.836341:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c069c0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681140992:0@lo:103: 00000100:00100000:2.0:1788201119.836363:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.836447:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681140864 00000100:00100000:2.0:1788201119.836452:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681140864 00010000:00010000:2.0:1788201119.836472:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 13 pid: 6511 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201119.836494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681140992 00000100:00100000:2.0:1788201119.836497:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681140992 00010000:00010000:2.0:1788201119.836508:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 14 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201119.836520:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201119.836525:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052f6b09c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:3647:x1875064681140864:12345-0@lo:103: 00010000:00010000:2.0:1788201119.836536:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201119.836541:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 14 pid: 6511 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836551:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 14 pid: 6511 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836572:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201119.836600:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052f6b09c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:3647:x1875064681140864:12345-0@lo:103: Request processed in 75us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.836608:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201119.836622:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201119.836628:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2a2482 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:3644:x1875064681140992:12345-0@lo:103: 00010000:00010000:2.0:1788201119.836644:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201119.836648:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 13 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836656:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 13 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.836665:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201119.836689:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2a2482 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:3644:x1875064681140992:12345-0@lo:103: Request processed in 62us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.836697:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201119.836762:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c069c0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681140992:0@lo:103: 00000100:00100000:2.0:1788201119.836789:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c82e8d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681140864:0@lo:103: 00000100:00100000:3.0:1788201119.837205:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa6cf8ba going to sleep for 11 seconds 00010000:00010000:3.0:1788201119.837222:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fe16 expref: 12 pid: 6511 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201119.837233:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875064681140480:0@lo:104: 00010000:00010000:3.0:1788201119.837242:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c8d0bcc8/0xf9b71aee4471fdad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fda6 expref: 11 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201119.837250:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088797d4f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875064681140608:0@lo:104: 00000100:00100000:1.0:1788201119.837296:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681140736 00000100:00100000:1.0:1788201119.837300:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681140736 00000100:00100000:1.0:1788201119.837330:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201119.837335:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f3e1d61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6511:x1875064681140736:12345-0@lo:104: 00010000:00010000:1.0:1788201119.837345:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201119.837436:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201119.837441:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f3e1d61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6511:x1875064681140736:12345-0@lo:104: Request processed in 107us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201119.837448:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788201119.837567:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201119.837572:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837580:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046cc19ec already unused, calling callback (00000000ee5bf388) 10000000:00010000:2.0:1788201119.837583:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837592:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201119.837598:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201119.837604:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201119.837640:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837652:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201119.837676:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837683:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fd8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fd91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837697:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201119.837699:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201119.837700:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201119.837707:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201119.837716:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c82e8d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681141120:0@lo:103: 00000100:00100000:2.0:1788201119.837791:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.837867:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681141120 00000100:00100000:2.0:1788201119.837872:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681141120 00010000:00010000:2.0:1788201119.837889:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 11 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201119.837910:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201119.837916:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c069c0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:3644:x1875064681141120:12345-0@lo:103: 00010000:00010000:2.0:1788201119.837924:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201119.837929:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 11 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837938:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 11 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837952:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837971:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837988:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.837994:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.838000:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.838007:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.838012:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008f30fe5 already unused, calling callback (00000000fc0d9d7c) 00010000:00010000:2.0:1788201119.838016:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.838023:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.838030:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.838046:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201119.838569:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c069c0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:3644:x1875064681141120:12345-0@lo:103: Request processed in 649us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.838578:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201119.838657:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c82e8d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681141120:0@lo:103: 00010000:00010000:3.0:1788201119.839052:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471fd91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fd8a expref: 10 pid: 6510 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201119.839138:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875064681140736:0@lo:104: 00010000:00010000:3.0:1788201119.839164:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.839186:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.839205:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.839212:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008f30fe5/0xf9b71aee4471fe5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201119.839229:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788201119.853539:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4d41d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:7445:x1875064681140352:12345-0@lo:253: Request processed in 41365us (41676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201119.853561:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201119.853800:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681140352:0@lo:253: 10000000:01000000:0.0:1788201119.853821:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788201119.853824:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201119.853827:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201119.853828:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201119.853829:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788201119.853831:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201119.853832:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201119.853839:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201119.853841:0:7445:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788201119.853843:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201119.853844:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201119.853886:0:7445:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000048251234 from lustre-MDT0001 10000000:01000000:0.0:1788201119.853933:0:7445:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788201119.853936:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788201119.853944:0:7445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0b2520000 local copy 10000000:01000000:0.0:1788201119.853949:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788201119.853996:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.854009:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.854019:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201119.854041:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141248:0@lo:101: 00000100:00100000:0.0:1788201119.854095:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201119.854143:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 000000005499a50b going to sleep for 11 seconds 00000100:00100000:2.0:1788201119.854533:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681141248 00000100:00100000:2.0:1788201119.854552:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681141248 00000100:00100000:2.0:1788201119.854608:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201119.854617:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca02b2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:7445:x1875064681141248:12345-0@lo:101: 00010000:00010000:2.0:1788201119.854644:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201119.854660:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fe6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fe63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.854697:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fe63 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.854709:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe63 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.854754:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3c18b6b, rc 0) 00000100:00100000:2.0:1788201119.854796:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca02b2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:7445:x1875064681141248:12345-0@lo:101: Request processed in 181us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.854803:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201119.855297:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141248:0@lo:101: 00010000:00010000:0.0:1788201119.855316:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.855325:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201119.855456:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141376:0@lo:501: 00000100:00100000:0.0:1788201119.855493:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201119.855633:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 000000005499a50b going to sleep for 11 seconds 00000100:00100000:3.0:1788201119.856015:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681141376 00000100:00100000:3.0:1788201119.856022:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681141376 00000100:00100000:3.0:1788201119.856219:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201119.856228:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000496b5cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:7445:x1875064681141376:12345-0@lo:501: 00000100:00100000:3.0:1788201119.856335:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000496b5cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:7445:x1875064681141376:12345-0@lo:501: Request processed in 109us (841us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201119.856343:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201119.856420:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141376:0@lo:501: 10000000:01000000:0.0:1788201119.856440:0:7445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788201119.856473:0:7445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788201119.856479:0:7445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.856489:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.856496:0:7445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.856525:0:7445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201119.856559:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce09e1da800 10000000:01000000:0.0:1788201119.856564:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201119.856570:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ce0b2520000 10000000:01000000:0.0:1788201119.856572:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788201119.856576:0:7445:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9ce0b2520000 from 1 10000000:01000000:0.0:1788201119.856579:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788201119.856608:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000e3c4ee2e/0xf9b71aee4471fe71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.856615:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000e3c4ee2e/0xf9b71aee4471fe71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.856635:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000e3c4ee2e/0xf9b71aee4471fe71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201119.856651:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141504:0@lo:101: 00000100:00100000:0.0:1788201119.856684:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201119.856729:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201119.856761:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201119.856770:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b986041e already unused, calling callback (00000000ee5bf388) 10000000:00010000:1.0:1788201119.856773:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201119.856782:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201119.856789:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201119.856795:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201119.856816:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201119.856823:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201119.856842:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201119.856859:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 00000000b986041e/0xf9b71aee4471fe63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee4471fe6a expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201119.856876:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201119.856877:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201119.856879:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201119.857355:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fb07c561 going to sleep for 11 seconds 00000100:00100000:2.0:1788201119.857446:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681141504 00000100:00100000:2.0:1788201119.857453:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681141504 00000100:00100000:2.0:1788201119.857493:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201119.857500:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005bfbd25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:7445:x1875064681141504:12345-0@lo:101: 00010000:00010000:2.0:1788201119.857514:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201119.857533:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5718fae/0xf9b71aee4471fe78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fe71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.857557:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5718fae/0xf9b71aee4471fe78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fe71 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.857567:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5718fae/0xf9b71aee4471fe78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe71 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.857589:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5718fae, rc 0) 00000100:00100000:2.0:1788201119.857696:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005bfbd25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:7445:x1875064681141504:12345-0@lo:101: Request processed in 188us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.857702:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201119.857757:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084c9f780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681141632:0@lo:103: 00000100:00100000:2.0:1788201119.857788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.857823:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681141632 00000100:00100000:2.0:1788201119.857826:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681141632 00000100:00100000:2.0:1788201119.857857:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201119.857863:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c5c83a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:3646:x1875064681141632:12345-0@lo:103: 00010000:00010000:2.0:1788201119.857871:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201119.857885:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fe6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4471fe63 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.857900:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201119.857924:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c5c83a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:3646:x1875064681141632:12345-0@lo:103: Request processed in 63us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.857931:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201119.857960:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084c9f780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681141632:0@lo:103: 00000100:00100000:0.0:1788201119.858515:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141504:0@lo:101: 00010000:00010000:0.0:1788201119.858545:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000e3c4ee2e/0xf9b71aee4471fe71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe78 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.858556:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000e3c4ee2e/0xf9b71aee4471fe71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fe78 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201119.858576:0:7445:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788201119.858790:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000e3c4ee2e/0xf9b71aee4471fe71 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe78 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.858799:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000e3c4ee2e/0xf9b71aee4471fe71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe78 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201119.858811:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ce09e1da800 10000000:01000000:0.0:1788201119.858816:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788201119.858821:0:7445:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ce09e1da800 from 1 10000000:01000000:0.0:1788201119.858824:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788201119.858852:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000097e6cd51/0xf9b71aee4471fe7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.858858:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000097e6cd51/0xf9b71aee4471fe7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.858866:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000097e6cd51/0xf9b71aee4471fe7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201119.858882:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141760:0@lo:101: 00000100:00100000:0.0:1788201119.858921:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201119.858954:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fb07c561 going to sleep for 11 seconds 00000100:00100000:2.0:1788201119.859038:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681141760 00000100:00100000:2.0:1788201119.859043:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681141760 00000100:00100000:2.0:1788201119.859241:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201119.859248:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c5b446 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:7445:x1875064681141760:12345-0@lo:101: 00010000:00010000:2.0:1788201119.859270:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201119.859281:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d2fa581/0xf9b71aee4471fe86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fe7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.859312:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d2fa581/0xf9b71aee4471fe86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fe7f expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.859322:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d2fa581/0xf9b71aee4471fe86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe7f expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201119.859330:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d2fa581, rc 0) 00000100:00100000:2.0:1788201119.859452:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c5b446 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:7445:x1875064681141760:12345-0@lo:101: Request processed in 204us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.859460:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201119.860206:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141760:0@lo:101: 00010000:00010000:0.0:1788201119.860236:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000097e6cd51/0xf9b71aee4471fe7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.860245:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000097e6cd51/0xf9b71aee4471fe7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201119.860274:0:7445:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788201119.860287:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000097e6cd51/0xf9b71aee4471fe7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.860295:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000097e6cd51/0xf9b71aee4471fe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201119.860303:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788201119.860308:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201119.860315:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ce09e1da800 10000000:01000000:0.0:1788201119.860319:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788201119.860322:0:7445:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788201119.860325:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201119.860350:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000029288532/0xf9b71aee4471fe8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.860355:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000029288532/0xf9b71aee4471fe8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.860363:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000029288532/0xf9b71aee4471fe8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201119.860378:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141888:0@lo:101: 00000100:00100000:0.0:1788201119.860420:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201119.860557:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fb07c561 going to sleep for 11 seconds 00000100:00100000:1.0:1788201119.860724:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681141888 00000100:00100000:1.0:1788201119.860731:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681141888 00000100:00100000:0.0:1788201119.861023:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201119.861032:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc58c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:7445:x1875064681141888:12345-0@lo:101: 00010000:00010000:0.0:1788201119.861112:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201119.861129:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fe8d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.861150:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.861160:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099c1d427/0xf9b71aee4471fe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201119.861168:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099c1d427, rc 0) 00000100:00100000:0.0:1788201119.861219:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc58c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681141888:12345-0@lo:101: Request processed in 189us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201119.861226:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201119.861309:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099005e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681141888:0@lo:101: 00010000:00010000:3.0:1788201119.861324:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000029288532/0xf9b71aee4471fe8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201119.861331:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000029288532/0xf9b71aee4471fe8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201119.861456:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142016:0@lo:501: 00000100:00100000:3.0:1788201119.861488:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201119.861774:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f73be7df going to sleep for 11 seconds 00000100:00100000:1.0:1788201119.861914:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681142016 00000100:00100000:1.0:1788201119.861920:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681142016 00000100:00100000:1.0:1788201119.861947:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201119.861953:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000befc5fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142016:12345-0@lo:501: 00000100:00100000:1.0:1788201119.862220:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000befc5fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142016:12345-0@lo:501: Request processed in 266us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201119.862228:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201119.862317:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142016:0@lo:501: 00000100:00100000:3.0:1788201119.862352:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142144:0@lo:503: 00000100:00100000:3.0:1788201119.862397:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201119.862423:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f73be7df going to sleep for 11 seconds 00000100:00100000:1.0:1788201119.862469:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681142144 00000100:00100000:1.0:1788201119.862473:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681142144 00000100:00100000:1.0:1788201119.862491:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201119.862496:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccfba64e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142144:12345-0@lo:503: 00000100:00100000:1.0:1788201119.862585:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccfba64e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142144:12345-0@lo:503: Request processed in 88us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201119.862591:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201119.863297:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142144:0@lo:503: 00010000:00010000:2.0:1788201119.863779:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201119.864017:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201119.864230:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142272:0@lo:502: 00000100:00100000:3.0:1788201119.864325:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201119.864412:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ecc911a1 going to sleep for 11 seconds 00000100:00100000:1.0:1788201119.864472:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681142272 00000100:00100000:1.0:1788201119.864479:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681142272 00000100:00100000:1.0:1788201119.864571:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201119.864580:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002012b5a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142272:12345-0@lo:502: 00000100:00100000:1.0:1788201119.864815:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002012b5a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142272:12345-0@lo:502: Request processed in 237us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201119.864830:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201119.865437:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142272:0@lo:502: 00000040:00080000:3.0:1788201119.865716:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788201119.865771:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788201119.865787:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788201119.865801:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788201119.865816:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788201119.865829:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788201119.865842:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788201119.865859:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788201119.865872:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788201119.865884:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788201119.865896:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788201119.865908:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788201119.865918:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788201119.865928:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788201119.865960:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788201119.865977:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788201119.865990:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788201119.866003:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788201119.866015:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788201119.866039:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788201119.866241:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788201119.866268:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788201119.866284:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788201119.866323:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142400:0@lo:502: 00000100:00100000:3.0:1788201119.866392:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201119.866452:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ecc911a1 going to sleep for 11 seconds 00000100:00100000:0.0:1788201119.866552:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681142400 00000100:00100000:0.0:1788201119.866561:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681142400 00000100:00100000:0.0:1788201119.866614:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201119.866683:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3be422f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142400:12345-0@lo:502: 00000100:00100000:0.0:1788201119.866828:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3be422f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142400:12345-0@lo:502: Request processed in 205us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201119.866835:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201119.866942:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142400:0@lo:502: 00000040:00080000:3.0:1788201119.866994:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788201119.867003:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788201119.868011:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201119.868027:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201119.868030:0:7457:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788201119.868036:0:7457:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788201119.868040:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201119.868175:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000cf5c9233) 00000020:00000080:3.0:1788201119.868200:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788201119.868208:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788201119.868332:0:7457:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201119.868344:0:7457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee4471fea2 00000020:00000080:3.0:1788201119.868600:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788201119.868605:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201119.868609:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201119.868610:0:7457:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788201119.868613:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201119.868617:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201119.868618:0:7457:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788201119.868621:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201119.868704:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000007ffffe1b) 00000020:00000080:3.0:1788201119.868717:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788201119.868722:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788201119.868730:0:7457:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788201119.868733:0:7457:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788201119.869173:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201119.869269:0:7457:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000048251234 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788201119.869294:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000f7ceb2a9) 00000020:00000080:0.0:1788201119.869306:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788201119.869378:0:7457:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201119.869388:0:7457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee4471feb7 00000020:00000080:0.0:1788201119.869514:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788201119.869521:0:7457:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201119.869526:0:7457:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf9b71aee4471febe 00080000:01000000:0.0:1788201119.869534:0:7457:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201119.869537:0:7457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee4471fec5 00080000:10000000:0.0:1788201119.870499:0:7457:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788201119.870895:0:7457:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788201120.012010:0:7457:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788201120.012445:0:7457:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788201120.016672:0:7457:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788201120.020021:0:7457:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788201120.063014:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788201120.063040:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201120.063051:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201120.063053:0:7457:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788201120.063058:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201120.063065:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201120.063067:0:7457:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788201120.063070:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201120.063076:0:7457:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:3.0:1788201120.063112:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201120.063133:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000f1363505) 00000020:00000080:3.0:1788201120.063162:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788201120.063168:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201120.063307:0:7457:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788201120.063315:0:7457:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788201120.063322:0:7457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee4471fed3 00010000:00080000:3.0:1788201120.063364:0:7457:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f828534f@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1788201120.075060:0:7457:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788201120.084421:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788201120.084441:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788201120.084492:0:7457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788201120.084516:0:7457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee4471feda 00000100:00080000:2.0:1788201120.084530:0:7457:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201120.084537:0:7457:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000f828534f using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201120.084588:0:7457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006d358065 x1875064681142528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201120.084673:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d358065 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681142528:0@lo:38: 00000100:00080000:2.0:1788201120.084979:0:7457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788201120.085046:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201120.085051:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.085053:0:7457:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788201120.085056:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201120.085059:0:7457:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788201120.085061:0:7457:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201120.085063:0:7457:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201120.085065:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201120.085067:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.085086:0:7457:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201120.085089:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201120.085095:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.085096:0:7457:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788201120.085100:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201120.085151:0:7457:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201120.085168:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201120.085172:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.085173:0:7457:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788201120.085176:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201120.085179:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.085180:0:7457:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201120.085183:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201120.085185:0:7457:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201120.085218:0:7457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201120.085221:0:7457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.085222:0:7457:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788201120.085225:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1788201120.085486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788201120.085586:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788201120.085626:0:7445:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788201120.085641:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000029288532/0xf9b71aee4471fe8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.085655:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000029288532/0xf9b71aee4471fe8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201120.085665:0:7445:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce09e1da800 from 1 10000000:01000000:0.0:1788201120.085668:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201120.085716:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.085728:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.085765:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.085791:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001eb954cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142656:0@lo:101: 00000100:00100000:0.0:1788201120.085823:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.085844:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 0000000073b8ddda going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.085989:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681142656 00000100:00100000:0.0:1788201120.085999:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681142656 00000100:00100000:0.0:1788201120.086046:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201120.086055:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021849b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+12:7445:x1875064681142656:12345-0@lo:101: 00010000:00010000:0.0:1788201120.086071:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201120.086084:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fee1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.086112:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.086122:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.086132:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068fc2e10, rc 0) 00000100:00100000:0.0:1788201120.086174:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021849b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:7445:x1875064681142656:12345-0@lo:101: Request processed in 119us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.086180:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201120.086233:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb954cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142656:0@lo:101: 00010000:00010000:0.0:1788201120.086248:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.086267:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201120.086832:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681142528 00000100:00100000:2.0:1788201120.086838:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681142528 00000100:00100000:2.0:1788201120.086932:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201120.086938:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008999426a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681142528:12345-0@lo:38: 00010000:00080000:2.0:1788201120.086964:0:6520:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1788201120.087004:0:6520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee4471feef 00000004:00100000:2.0:1788201120.087022:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788201120.087029:0:6520:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788201120.088352:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201120.088381:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681142784:0@lo:400: 00000100:00100000:1.0:1788201120.088458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.088973:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681142784 00000100:00100000:3.0:1788201120.088982:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681142784 00000100:00100000:3.0:1788201120.089040:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201120.089049:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aebce42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681142784:12345-0@lo:400: 00000100:00100000:3.0:1788201120.089117:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aebce42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681142784:12345-0@lo:400: Request processed in 69us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.089124:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788201120.089169:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003ecde34f x1875064681142784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201120.089185:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681142784:0@lo:400: 00000100:00100000:3.0:1788201120.089647:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142912:0@lo:256: 00000100:00100000:3.0:1788201120.089694:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.089728:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 000000001d969198 going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.089810:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681142912 00000100:00100000:1.0:1788201120.089816:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681142912 00000100:00100000:1.0:1788201120.089846:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201120.089852:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000690f438a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:7445:x1875064681142912:12345-0@lo:256: 20000000:01000000:2.0:1788201120.090968:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201120.090993:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201120.090997:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788201120.091110:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000690f438a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:7445:x1875064681142912:12345-0@lo:256: Request processed in 1257us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.091128:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201120.091242:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681142912:0@lo:256: 10000000:01000000:3.0:1788201120.092333:0:7445:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201120.092363:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.092377:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201120.092387:0:7445:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce09e1da800 from 1 10000000:01000000:3.0:1788201120.092390:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201120.092429:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.092437:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.092446:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201120.092469:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143040:0@lo:101: 00000100:00100000:3.0:1788201120.092520:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.092563:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 000000001d969198 going to sleep for 11 seconds 00000100:00100000:2.0:1788201120.092646:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681143040 00000100:00100000:2.0:1788201120.092653:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681143040 00000100:00100000:2.0:1788201120.092711:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201120.092720:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088006473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:7445:x1875064681143040:12345-0@lo:101: 00010000:00010000:2.0:1788201120.092734:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201120.092767:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fef6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.092791:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.092802:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.092812:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3c18b6b, rc 0) 00000100:00100000:2.0:1788201120.092846:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088006473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:7445:x1875064681143040:12345-0@lo:101: Request processed in 127us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.092853:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201120.093006:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143040:0@lo:101: 00010000:00010000:3.0:1788201120.093021:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.093045:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201120.093151:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143168:0@lo:501: 00000100:00100000:3.0:1788201120.093177:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.093199:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 000000001d969198 going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.093214:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681143168 00000100:00100000:3.0:1788201120.093217:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681143168 00000100:00100000:3.0:1788201120.093244:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201120.093250:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cff00593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143168:12345-0@lo:501: 00000100:00100000:3.0:1788201120.093368:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cff00593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143168:12345-0@lo:501: Request processed in 118us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.093374:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201120.093414:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143168:0@lo:501: 00000100:00100000:3.0:1788201120.093441:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143296:0@lo:503: 00000100:00100000:3.0:1788201120.093479:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.093492:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 000000001d969198 going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.093505:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681143296 00000100:00100000:3.0:1788201120.093508:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681143296 00000100:00100000:3.0:1788201120.093527:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201120.093532:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2295f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143296:12345-0@lo:503: 00000040:00080000:3.0:1788201120.093573:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201120.093608:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2295f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143296:12345-0@lo:503: Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.093615:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201120.093660:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ecde34f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143296:0@lo:503: 00000040:00080000:2.0:1788201120.095154:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201120.095217:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788201120.095325:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788201120.097205:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000c72ba646 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201120.098243:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008999426a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681142528:12345-0@lo:38: Request processed in 11295us (12749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.098274:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201120.098414:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201120.098428:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788201120.098440:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788201120.098449:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201120.098452:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000f828534f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201120.098473:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d358065 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681142528:0@lo:38: 00000100:00100000:3.0:1788201120.098630:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004de64a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681143424:0@lo:41: 00000100:00100000:3.0:1788201120.098678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.099034:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681143424 00000100:00100000:1.0:1788201120.099044:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681143424 00000100:00100000:1.0:1788201120.099093:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201120.099101:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ecde34f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875064681143424:12345-0@lo:41: 00000004:00000024:1.0:1788201120.099137:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788201120.099193:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ecde34f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875064681143424:12345-0@lo:41: Request processed in 93us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.099200:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201120.099349:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004de64a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681143424:0@lo:41: 00000040:00080000:2.0:1788201120.099423:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788201120.099580:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788201120.099620:0:7445:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201120.099635:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.099647:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201120.099713:0:7445:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201120.099717:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce09e1da800 10000000:01000000:0.0:1788201120.099720:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce09e1da800 10000000:01000000:0.0:1788201120.099724:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201120.099731:0:7445:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce09e1da800 from 1 10000000:01000000:0.0:1788201120.099734:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201120.099792:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000234ad367/0xf9b71aee4471ff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.099801:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000234ad367/0xf9b71aee4471ff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.099811:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000234ad367/0xf9b71aee4471ff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.099829:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001eb954cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143552:0@lo:101: 00000100:00100000:0.0:1788201120.099993:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.100038:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681143552 00000100:00100000:0.0:1788201120.100038:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a526c1e going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.100045:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681143552 00000100:00100000:3.0:1788201120.100077:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201120.100083:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064e4842d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:7445:x1875064681143552:12345-0@lo:101: 00010000:00010000:3.0:1788201120.100093:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201120.100106:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471ff0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ff04 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.100131:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471ff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.100141:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d38edc5c/0xf9b71aee4471ff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.100150:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d38edc5c, rc 0) 00000100:00100000:3.0:1788201120.100187:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064e4842d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143552:12345-0@lo:101: Request processed in 104us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.100194:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201120.100490:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb954cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143552:0@lo:101: 00010000:00010000:0.0:1788201120.101247:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000234ad367/0xf9b71aee4471ff04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.101271:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000234ad367/0xf9b71aee4471ff04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201120.103222:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dabe7e62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143680:0@lo:501: 00000100:00100000:2.0:1788201120.103449:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.103505:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e1d20c45 going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.103782:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681143680 00000100:00100000:3.0:1788201120.103791:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681143680 00000100:00100000:3.0:1788201120.103849:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201120.103858:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dec30906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143680:12345-0@lo:501: 00000100:00100000:3.0:1788201120.104018:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dec30906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143680:12345-0@lo:501: Request processed in 160us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.104026:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201120.104202:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dabe7e62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143680:0@lo:501: 00000100:00100000:2.0:1788201120.104244:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dabe7e62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143808:0@lo:503: 00000100:00100000:2.0:1788201120.104311:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.104339:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e1d20c45 going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.104380:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681143808 00000100:00100000:3.0:1788201120.104384:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681143808 00000100:00100000:3.0:1788201120.104414:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201120.104420:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a7da217 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143808:12345-0@lo:503: 00000100:00100000:3.0:1788201120.104542:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a7da217 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143808:12345-0@lo:503: Request processed in 122us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.104549:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201120.110141:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dabe7e62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143808:0@lo:503: 00000040:00080000:2.0:1788201120.110890:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201120.111214:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dabe7e62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143936:0@lo:502: 00000100:00100000:2.0:1788201120.111375:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.111430:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e1d20c45 going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.111622:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681143936 00000100:00100000:0.0:1788201120.111630:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681143936 00000100:00100000:0.0:1788201120.111770:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201120.111782:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039504987 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143936:12345-0@lo:502: 00000100:00100000:2.0:1788201120.112143:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039504987 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681143936:12345-0@lo:502: Request processed in 363us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.112152:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201120.112231:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dabe7e62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681143936:0@lo:502: 00000040:00080000:0.0:1788201120.112475:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788201120.113671:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788201120.113720:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788201120.113734:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788201120.113763:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788201120.113776:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788201120.113786:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788201120.113797:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788201120.113808:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788201120.113819:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788201120.113832:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788201120.113844:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788201120.113855:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788201120.113867:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788201120.113878:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788201120.113888:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788201120.113923:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788201120.113937:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788201120.113948:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788201120.113969:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788201120.113980:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788201120.113991:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788201120.114003:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788201120.114016:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788201120.114027:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788201120.114038:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788201120.114051:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788201120.114063:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788201120.114110:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001eb954cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681144064:0@lo:502: 00000100:00100000:0.0:1788201120.114196:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.114254:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a526c1e going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.114328:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681144064 00000100:00100000:3.0:1788201120.114338:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681144064 00000100:00100000:3.0:1788201120.114394:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201120.114403:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067e3daf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681144064:12345-0@lo:502: 00000100:00100000:3.0:1788201120.114539:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067e3daf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681144064:12345-0@lo:502: Request processed in 137us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.114547:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201120.114727:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb954cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681144064:0@lo:502: 00000040:00080000:2.0:1788201120.121943:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788201120.121973:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788201120.123009:0:7463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788201120.123031:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000727b7dd9) 00000020:00000080:2.0:1788201120.123058:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788201120.123412:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000048251234 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788201120.123417:0:7463:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000048251234 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788201120.123420:0:7463:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000048251234 3 00010000:00080000:2.0:1788201120.123486:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000af185a34@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201120.130488:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788201120.132063:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788201120.132155:0:7463:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201120.132171:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf9b71aee4471ff19 00000100:00080000:1.0:1788201120.132184:0:7463:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201120.132190:0:7463:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000af185a34 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201120.132239:0:7463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007ef1f817 x1875064681144192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201120.134803:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788201120.134808:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007ef1f817 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681144192:0@lo:38: 00000100:00100000:3.0:1788201120.135032:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.135121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681144192 00000100:00100000:3.0:1788201120.135131:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681144192 00000100:00100000:3.0:1788201120.135173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201120.135182:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088797d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875064681144192:12345-0@lo:38: 00010000:00080000:3.0:1788201120.135229:0:6516:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1788201120.135286:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf9b71aee4471ff20 00000004:00100000:3.0:1788201120.135304:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201120.135342:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000de5ae846 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201120.135410:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088797d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875064681144192:12345-0@lo:38: Request processed in 228us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.135417:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788201120.135622:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007ef1f817 x1875064681144192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201120.135634:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201120.135643:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788201120.135651:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788201120.135657:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201120.135659:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000af185a34 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201120.135664:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007ef1f817 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681144192:0@lo:38: 00000040:00080000:1.0:1788201120.135931:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1788201120.136212:0:7465:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1788201120.136226:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788201120.136280:0:7445:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201120.136312:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000234ad367/0xf9b71aee4471ff04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.136325:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000234ad367/0xf9b71aee4471ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201120.136382:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201120.136385:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201120.136386:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201120.136387:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201120.136388:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201120.136390:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201120.136391:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201120.136392:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201120.136394:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201120.136395:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201120.136396:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201120.136401:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788201120.136403:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201120.136405:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201120.136406:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201120.136407:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201120.136408:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201120.136409:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201120.136415:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201120.136416:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201120.136417:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201120.136418:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201120.136419:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201120.136444:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788201120.136463:0:7445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681144320:0@lo:253: 00000100:00100000:3.0:1788201120.136521:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.136569:0:7445:0:(client.c:2702:ptlrpc_set_wait()) set 0000000057810166 going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.136666:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681144320 00000100:00100000:0.0:1788201120.136673:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681144320 00000100:00100000:0.0:1788201120.136720:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201120.136729:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070331fdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7445:x1875064681144320:12345-0@lo:253: 20000000:01000000:0.0:1788201120.136790:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788201120.138785:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788201120.144798:0:6495:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788201120.146526:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201120.146549:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788201120.146687:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201120.146694:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201120.146720:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.146883:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.146891:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.146899:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.146951:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.146966:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 15 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201120.146984:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681144448:0@lo:104: 00000100:00100000:1.0:1788201120.147287:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201120.147351:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.147360:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 15 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201120.147391:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c86f2a2e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681144576:0@lo:104: 00000100:00100000:1.0:1788201120.147413:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.147437:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d47161a5 going to sleep for 11 seconds 00000100:00100000:2.0:1788201120.147841:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681144448 00000100:00100000:2.0:1788201120.147851:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681144448 00000100:00100000:0.0:1788201120.147930:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681144576 00000100:00100000:0.0:1788201120.147936:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681144576 00000100:00100000:0.0:1788201120.147986:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201120.147996:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e0f315d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6531:x1875064681144576:12345-0@lo:104: 00010000:00010000:0.0:1788201120.148011:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.148095:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201120.148101:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e0f315d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6531:x1875064681144576:12345-0@lo:104: Request processed in 108us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.148108:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788201120.148130:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201120.148132:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788201120.148139:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.148142:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1823b32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6531:x1875064681144448:12345-0@lo:104: 00010000:00010000:0.0:1788201120.148155:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.148156:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f4d402b7 already unused, calling callback (00000000ee5bf388) 10000000:00010000:2.0:1788201120.148162:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.148186:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201120.148194:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201120.148200:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201120.148202:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201120.148207:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1823b32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6531:x1875064681144448:12345-0@lo:104: Request processed in 68us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.148213:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788201120.148234:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201120.148236:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.148243:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201120.148273:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.148280:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 00000000f4d402b7/0xf9b71aee4471fe40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe47 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.148295:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201120.148297:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201120.148299:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201120.148378:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e903126e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681144704:0@lo:103: 00000100:00100000:0.0:1788201120.148410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.148473:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681144704 00000100:00100000:0.0:1788201120.148477:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681144704 00010000:00010000:0.0:1788201120.148494:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 16 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.148546:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201120.148552:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001eb954cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:3645:x1875064681144704:12345-0@lo:103: 00000100:00100000:1.0:1788201120.148955:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681144448:0@lo:104: 00000100:00100000:1.0:1788201120.148966:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c86f2a2e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681144576:0@lo:104: 00010000:00010000:1.0:1788201120.148991:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.149721:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201120.149732:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 16 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.149769:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 16 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.149789:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7b4cba4/0xf9b71aee4471fe47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fe40 expref: 16 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.151333:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201120.151454:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001eb954cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3645:x1875064681144704:12345-0@lo:103: Request processed in 2898us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.151470:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201120.151571:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e903126e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681144704:0@lo:103: 00000100:00100000:3.0:1788201120.152280:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070331fdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:7445:x1875064681144320:12345-0@lo:253: Request processed in 15549us (15755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.152291:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201120.152779:0:7445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7445:1875064681144320:0@lo:253: 10000000:01000000:0.0:1788201120.152797:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788201120.152800:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201120.152802:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201120.152803:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201120.152804:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201120.152805:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201120.152806:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201120.152808:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201120.152809:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201120.152811:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201120.152812:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201120.152845:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788201120.152860:0:7445:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788201120.158784:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201120.158794:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201120.158797:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201120.158844:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.158862:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046cc19ec already unused, calling callback (00000000ee5bf388) 10000000:00010000:1.0:1788201120.158866:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.159042:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201120.159050:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201120.159056:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201120.159120:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.159127:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201120.159360:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201120.159378:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788201120.159383:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 0000000046cc19ec/0xf9b71aee4471fee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fee8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201120.159404:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c86f2a2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681144832:0@lo:103: 00010000:00010000:1.0:1788201120.159409:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201120.159412:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201120.159414:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201120.160124:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.163215:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681144832 00000100:00100000:1.0:1788201120.163231:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681144832 00010000:00010000:1.0:1788201120.163295:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 14 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201120.163388:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201120.163400:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dc5466b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:3647:x1875064681144832:12345-0@lo:103: 00010000:00010000:1.0:1788201120.163420:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201120.163426:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 14 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163440:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 14 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163462:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068fc2e10/0xf9b71aee4471fee8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fee1 expref: 14 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163480:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163489:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201120.163532:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016838863s 00010000:00010000:1.0:1788201120.163537:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163544:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163550:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163557:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163564:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000731b4f82 already unused, calling callback (00000000fc0d9d7c) 00010000:00010000:1.0:1788201120.163567:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163575:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163600:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.163613:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201120.163705:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dc5466b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:3647:x1875064681144832:12345-0@lo:103: Request processed in 308us (4210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.163713:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788201120.163795:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.163807:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201120.163813:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000731b4f82/0xf9b71aee4471ff27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788201120.164041:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788201120.164272:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788201120.164525:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00000100:00100000:1.0:1788201120.164646:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c86f2a2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681144832:0@lo:103: 00080000:10000000:3.0:1788201120.167114:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788201120.167409:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788201120.169062:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788201120.172530:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788201120.173098:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788201120.173302:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788201120.173479:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788201120.173683:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788201120.175601:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788201120.180237:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788201120.180284:0:7469:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788201120.180289:0:7469:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788201120.181219:0:7470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788201120.181294:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788201120.181664:0:7470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0c15c5f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875064681144960:0@lo:700: 00000100:00100000:3.0:1788201120.182660:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.182790:0:7470:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a6518ae1 going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.182815:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681144960 00000100:00100000:1.0:1788201120.182827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681144960 00000100:00100000:1.0:1788201120.183170:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201120.183184:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025a31c1c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7470:x1875064681144960:12345-0@lo:700: 00000040:01000000:0.0:1788201120.184366:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788201120.184513:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201120.184853:0:7471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f75e157 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145088:0@lo:1000: 00000100:00100000:3.0:1788201120.184961:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.185016:0:7471:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd177cc1 going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.185143:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681145088 00000100:00100000:1.0:1788201120.185152:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681145088 00000100:00100000:1.0:1788201120.185208:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201120.185217:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a72e3e7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145088:12345-0@lo:1000: 00000100:00100000:1.0:1788201120.185336:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a72e3e7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145088:12345-0@lo:1000: Request processed in 121us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.185345:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201120.186336:0:7471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f75e157 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145088:0@lo:1000: 00000040:01000000:3.0:1788201120.186381:0:7471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788201120.186427:0:7471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f75e157 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145216:0@lo:700: 00000100:00100000:3.0:1788201120.186475:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:0.0:1788201120.187014:0:7445:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788201120.187029:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788201120.187368:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201120.188418:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788201120.189012:0:7471:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050518c14 going to sleep for 11 seconds 00000040:00080000:1.0:1788201120.190239:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788201120.190358:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788201120.190665:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788201120.190990:0:7445:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788201120.191816:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788201120.191980:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788201120.192173:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788201120.192365:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788201120.192538:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788201120.192629:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000100:00100000:2.0:1788201120.193896:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681145216 00000100:00100000:2.0:1788201120.193912:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681145216 00000100:00100000:2.0:1788201120.193977:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201120.193987:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037a029ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145216:12345-0@lo:700: 00000100:00100000:2.0:1788201120.194120:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037a029ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145216:12345-0@lo:700: Request processed in 134us (7646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.194128:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201120.194330:0:7471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f75e157 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145216:0@lo:700: 00000100:00100000:0.0:1788201120.194478:0:7471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ac7ccaba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7471:1875064681145344:0@lo:900: 00000100:00100000:0.0:1788201120.194986:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.195055:0:7471:0:(client.c:2702:ptlrpc_set_wait()) set 000000008b61e61d going to sleep for 11 seconds 00000100:00100000:2.0:1788201120.195098:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681145344 00000100:00100000:2.0:1788201120.195112:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681145344 00000100:00100000:2.0:1788201120.195177:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201120.195192:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037b4644c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7471:x1875064681145344:12345-0@lo:900: 00000100:00100000:2.0:1788201120.195240:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037b4644c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7471:x1875064681145344:12345-0@lo:900: Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.195247:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 40000000:02000000:0.0:1788201120.195362:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1788201120.199659:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00010000:00080000:2.0:1788201120.199701:0:7471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ac7ccaba x1875064681145344/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201136 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201120.199723:0:7471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ac7ccaba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7471:1875064681145344:0@lo:900: 00000100:00100000:2.0:1788201120.199980:0:7471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004d4c81d8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145472:0@lo:1000: 00000100:00100000:2.0:1788201120.200085:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.200139:0:7471:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a97310e1 going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.200319:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681145472 00000100:00100000:3.0:1788201120.200328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681145472 00000100:00100000:0.0:1788201120.200364:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025a31c1c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7470:x1875064681144960:12345-0@lo:700: Request processed in 17182us (17706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.200380:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201120.200393:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201120.200405:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6f3a3de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145472:12345-0@lo:1000: 00010000:00080000:2.0:1788201120.200688:0:7470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b0c15c5f x1875064681144960/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788201136 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201120.200708:0:7470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0c15c5f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875064681144960:0@lo:700: 40000000:02000000:2.0:1788201120.200718:0:7470:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1788201120.201179:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6f3a3de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145472:12345-0@lo:1000: Request processed in 776us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.201252:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00100000:10000000:1.0:1788201120.201274:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788201120.201490:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788201120.201666:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788201120.202278:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788201120.202424:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788201120.203403:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000100:00100000:0.0:1788201120.203683:0:7471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004d4c81d8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145472:0@lo:1000: 00000004:00080000:0.0:1788201120.204200:0:7471:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000009d6af0a with version 0 00000020:00100000:0.0:1788201120.204231:0:7471:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201120.204239:0:7471:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ef680cda x1875064681145728/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201120.204276:0:7471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145728:0@lo:1000: 00000100:00100000:0.0:1788201120.204370:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.204426:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681145728 00000100:00100000:0.0:1788201120.204431:0:7471:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d469b6e3 going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.204437:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681145728 00000100:00100000:3.0:1788201120.204509:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201120.204518:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000584a0d1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145728:12345-0@lo:1000: 00100000:10000000:1.0:1788201120.205887:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788201120.208314:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788201120.208604:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788201120.214970:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788201120.216906:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000001:00080000:0.0:1788201120.219825:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1788201120.220025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000584a0d1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145728:12345-0@lo:1000: Request processed in 15500us (15647us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788201120.220043:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788201120.220130:0:7471:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788201120.220138:0:7471:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788201120.220158:0:7471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145728:0@lo:1000: 00000100:00100000:0.0:1788201120.220286:0:7471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145856:0@lo:1000: 00000100:00100000:0.0:1788201120.220349:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.220413:0:7471:0:(client.c:2702:ptlrpc_set_wait()) set 000000008b61e61d going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.220423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681145856 00000100:00100000:3.0:1788201120.220435:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681145856 00000100:00100000:3.0:1788201120.220500:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201120.220509:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cbb7af4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145856:12345-0@lo:1000: 00000100:00100000:3.0:1788201120.220617:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cbb7af4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1875064681145856:12345-0@lo:1000: Request processed in 109us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.220638:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201120.220643:0:7471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1875064681145856:0@lo:1000: 00000040:00080000:0.0:1788201120.220678:0:7471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788201120.220713:0:7471:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000b918ae07 with version 1 00000004:00080000:3.0:1788201120.220784:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f0662f2e version 1 rpc_version 1 00000020:00100000:3.0:1788201120.220817:0:7460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201120.220825:0:7460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004113fba6 x1875064681146112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201120.220846:0:7460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004113fba6 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1875064681146112:0@lo:1000: 00000100:00100000:3.0:1788201120.220901:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.220943:0:7460:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd177cc1 going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.220959:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681146112 00000100:00100000:3.0:1788201120.220963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681146112 00000100:00100000:3.0:1788201120.220987:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201120.220992:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8891fd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7460:x1875064681146112:12345-0@lo:1000: 00000040:00080000:0.0:1788201120.223876:0:7471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201120.223990:0:7471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1788201120.226830:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1788201120.227121:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8891fd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7460:x1875064681146112:12345-0@lo:1000: Request processed in 6125us (6217us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788201120.227165:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1788201120.227448:0:7460:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788201120.227455:0:7460:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788201120.227478:0:7460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004113fba6 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1875064681146112:0@lo:1000: 00100000:10000000:0.0:1788201120.227942:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788201120.228491:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788201120.229566:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788201120.231325:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788201120.231542:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000040:00080000:1.0:1788201120.231940:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1788201120.232304:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788201120.232472:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788201120.232608:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788201120.233373:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788201120.236097:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788201120.236307:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788201120.236450:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788201120.236654:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788201120.236843:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788201120.238490:0:7445:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788201120.242085:0:7470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201120.242182:0:7470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201120.242188:0:7470:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788201120.257673:0:7445:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788201120.257728:0:7445:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc15181cbf988 00100000:10000000:2.0:1788201120.257759:0:7445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788201120.263616:0:7445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201120.263668:0:7445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201120.263721:0:7445:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788201120.263775:0:7445:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788201120.265522:0:7445:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201120.266318:0:7445:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 10000000:01000000:2.0:1788201120.358857:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201120.358866:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce09e1da800 from 4 10000000:01000000:2.0:1788201120.358872:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201120.358939:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000921cc304/0xf9b71aee4471ff2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.359009:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000921cc304/0xf9b71aee4471ff2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.359023:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000921cc304/0xf9b71aee4471ff2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201120.359054:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000314bc577 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146240:0@lo:101: 00000100:00100000:2.0:1788201120.359160:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.359676:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 0000000098e15a35 going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.370541:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681146240 00000100:00100000:0.0:1788201120.370563:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681146240 00000100:00100000:0.0:1788201120.370655:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201120.370666:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8ebe9bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:6513:x1875064681146240:12345-0@lo:101: 00010000:00010000:0.0:1788201120.370693:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201120.370723:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3a300b4/0xf9b71aee4471ff35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ff2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.370776:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3a300b4/0xf9b71aee4471ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.370788:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3a300b4/0xf9b71aee4471ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.370799:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3a300b4, rc 0) 00000100:00100000:0.0:1788201120.370897:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8ebe9bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:6513:x1875064681146240:12345-0@lo:101: Request processed in 233us (11736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.370904:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201120.370979:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000314bc577 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146240:0@lo:101: 00010000:00010000:0.0:1788201120.371001:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000921cc304/0xf9b71aee4471ff2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.371011:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000921cc304/0xf9b71aee4471ff2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.371092:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146368:0@lo:256: 00000100:00100000:0.0:1788201120.371142:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.371352:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9aa515f going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.371845:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681146368 00000100:00100000:3.0:1788201120.371853:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681146368 00000100:00100000:3.0:1788201120.371893:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201120.373449:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000defa08a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:6513:x1875064681146368:12345-0@lo:256: 20000000:01000000:3.0:1788201120.373489:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201120.373518:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201120.373522:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788201120.373696:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000defa08a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:6513:x1875064681146368:12345-0@lo:256: Request processed in 273us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.373705:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201120.376123:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146368:0@lo:256: 10000000:01000000:0.0:1788201120.376705:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201120.376720:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000921cc304/0xf9b71aee4471ff2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.376732:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000921cc304/0xf9b71aee4471ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201120.376765:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201120.376768:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0889be000 from 21 10000000:01000000:0.0:1788201120.376771:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201120.376816:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000061685295/0xf9b71aee4471ff3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.376823:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000061685295/0xf9b71aee4471ff3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.376834:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000061685295/0xf9b71aee4471ff3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.376857:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146496:0@lo:101: 00000100:00100000:0.0:1788201120.376932:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.376978:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9aa515f going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.377001:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681146496 00000100:00100000:0.0:1788201120.377008:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681146496 00000100:00100000:0.0:1788201120.377057:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201120.377067:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000489a0cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:6513:x1875064681146496:12345-0@lo:101: 00010000:00010000:0.0:1788201120.377097:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201120.377111:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ed68740/0xf9b71aee4471ff43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ff3c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.377139:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ed68740/0xf9b71aee4471ff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.377149:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ed68740/0xf9b71aee4471ff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.377159:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ed68740, rc 0) 00000100:00100000:0.0:1788201120.377391:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000489a0cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681146496:12345-0@lo:101: Request processed in 324us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.377399:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201120.377451:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146496:0@lo:101: 00010000:00010000:0.0:1788201120.377467:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000061685295/0xf9b71aee4471ff3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.377476:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000061685295/0xf9b71aee4471ff3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.377541:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146624:0@lo:501: 00000100:00100000:0.0:1788201120.377569:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.377599:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9aa515f going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.377614:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681146624 00000100:00100000:0.0:1788201120.377618:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681146624 00000100:00100000:0.0:1788201120.377642:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201120.377647:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ac533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681146624:12345-0@lo:501: 00000100:00100000:0.0:1788201120.377818:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ac533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681146624:12345-0@lo:501: Request processed in 170us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.377825:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201120.377856:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146624:0@lo:501: 00000100:00100000:0.0:1788201120.377881:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146752:0@lo:503: 00000100:00100000:0.0:1788201120.377920:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.377933:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9aa515f going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.377946:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681146752 00000100:00100000:0.0:1788201120.377949:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681146752 00000100:00100000:0.0:1788201120.377970:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201120.377975:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090f6048f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681146752:12345-0@lo:503: 00000100:00100000:0.0:1788201120.378055:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090f6048f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681146752:12345-0@lo:503: Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.378062:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201120.378101:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef680cda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681146752:0@lo:503: 00000100:00100000:1.0:1788201120.409662:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c86f2a2e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7477:1875064681146880:0@lo:502: 00000100:00100000:1.0:1788201120.409799:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.409859:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a80bb494 going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.409964:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681146880 00000100:00100000:0.0:1788201120.409973:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681146880 00000100:00100000:0.0:1788201120.410035:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201120.410046:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d829b9c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7477:x1875064681146880:12345-0@lo:502: 00000100:00100000:0.0:1788201120.410282:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d829b9c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7477:x1875064681146880:12345-0@lo:502: Request processed in 237us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.410291:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201120.413537:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c86f2a2e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7477:1875064681146880:0@lo:502: 00000100:00100000:1.0:1788201120.422429:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c86f2a2e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7477:1875064681147008:0@lo:502: 00000100:00100000:1.0:1788201120.422537:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.422735:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a80bb494 going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.422842:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681147008 00000100:00100000:0.0:1788201120.422853:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681147008 00000100:00100000:0.0:1788201120.422921:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201120.422929:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b86760b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7477:x1875064681147008:12345-0@lo:502: 00000100:00100000:0.0:1788201120.423084:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b86760b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:7477:x1875064681147008:12345-0@lo:502: Request processed in 155us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.423093:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201120.423979:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c86f2a2e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7477:1875064681147008:0@lo:502: 00000040:00080000:3.0:1788201120.424025:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788201120.425125:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788201120.425161:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201120.425173:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000061685295/0xf9b71aee4471ff3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.425268:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000061685295/0xf9b71aee4471ff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201120.425279:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201120.425282:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0889be000 from 4 10000000:01000000:2.0:1788201120.425298:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201120.425343:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000e756fb59/0xf9b71aee4471ff4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.425351:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000e756fb59/0xf9b71aee4471ff4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.425362:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000e756fb59/0xf9b71aee4471ff4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201120.425389:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000686f0179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147136:0@lo:101: 00000100:00100000:2.0:1788201120.425464:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.425516:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 000000005c299c9d going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.427242:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681147136 00000100:00100000:0.0:1788201120.427273:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681147136 00000100:00100000:0.0:1788201120.427524:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201120.427535:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077234e41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681147136:12345-0@lo:101: 00010000:00010000:0.0:1788201120.427561:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201120.427583:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000199d5868/0xf9b71aee4471ff51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ff4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.427619:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000199d5868/0xf9b71aee4471ff51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.427631:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000199d5868/0xf9b71aee4471ff51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.427640:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000199d5868, rc 0) 00000100:00100000:0.0:1788201120.427770:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077234e41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681147136:12345-0@lo:101: Request processed in 204us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.427777:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201120.428810:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000686f0179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147136:0@lo:101: 00010000:00010000:2.0:1788201120.428840:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000e756fb59/0xf9b71aee4471ff4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201120.428852:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000e756fb59/0xf9b71aee4471ff4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201120.428940:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000686f0179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147264:0@lo:256: 00000100:00100000:2.0:1788201120.428999:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.429025:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 000000005c299c9d going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.429331:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681147264 00000100:00100000:1.0:1788201120.429341:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681147264 00000100:00100000:1.0:1788201120.429398:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201120.429407:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e9b3f19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681147264:12345-0@lo:256: 20000000:01000000:1.0:1788201120.429431:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201120.429452:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201120.429455:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788201120.429550:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e9b3f19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681147264:12345-0@lo:256: Request processed in 143us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.429558:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201120.429603:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000686f0179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147264:0@lo:256: 10000000:01000000:1.0:1788201120.429647:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201120.429655:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000e756fb59/0xf9b71aee4471ff4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.429663:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000e756fb59/0xf9b71aee4471ff4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201120.429672:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788201120.429674:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788201120.429678:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201120.429705:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000075f150c3/0xf9b71aee4471ff58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.429711:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000075f150c3/0xf9b71aee4471ff58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.429720:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000075f150c3/0xf9b71aee4471ff58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201120.429767:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147392:0@lo:101: 00000100:00100000:1.0:1788201120.429793:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.429819:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f3210ea going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.429832:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681147392 00000100:00100000:1.0:1788201120.429836:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681147392 00000100:00100000:1.0:1788201120.429860:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201120.429865:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000500aeab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681147392:12345-0@lo:101: 00010000:00010000:1.0:1788201120.429874:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201120.429886:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000056a38eef/0xf9b71aee4471ff5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ff58 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.429903:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056a38eef/0xf9b71aee4471ff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.429911:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000056a38eef/0xf9b71aee4471ff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.429919:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000056a38eef, rc 0) 00000100:00100000:1.0:1788201120.429942:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000500aeab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681147392:12345-0@lo:101: Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.429947:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201120.429973:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147392:0@lo:101: 00010000:00010000:1.0:1788201120.429983:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000075f150c3/0xf9b71aee4471ff58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201120.429989:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000075f150c3/0xf9b71aee4471ff58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201120.430051:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147520:0@lo:501: 00000100:00100000:1.0:1788201120.430073:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.430085:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f3210ea going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.430095:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681147520 00000100:00100000:1.0:1788201120.430098:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681147520 00000100:00100000:1.0:1788201120.430115:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201120.430119:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ffd3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681147520:12345-0@lo:501: 00000100:00100000:1.0:1788201120.430271:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ffd3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681147520:12345-0@lo:501: Request processed in 150us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.430277:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201120.430306:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147520:0@lo:501: 00000100:00100000:1.0:1788201120.430330:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147648:0@lo:503: 00000100:00100000:1.0:1788201120.430376:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.430388:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f3210ea going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.430399:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681147648 00000100:00100000:1.0:1788201120.430402:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681147648 00000100:00100000:1.0:1788201120.430421:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201120.430426:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f08b96ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681147648:12345-0@lo:503: 00000100:00100000:1.0:1788201120.430504:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f08b96ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681147648:12345-0@lo:503: Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.430510:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201120.430546:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681147648:0@lo:503: 00000100:00100000:2.0:1788201120.434691:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000396e4d5a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7479:1875064681147776:0@lo:502: 00000100:00100000:3.0:1788201120.441712:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.441840:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 000000007ab40b11 going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.441917:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681147776 00000100:00100000:0.0:1788201120.441929:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681147776 00000100:00100000:0.0:1788201120.441991:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201120.442001:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000646ecaa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:7479:x1875064681147776:12345-0@lo:502: 00000100:00100000:0.0:1788201120.442199:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000646ecaa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:7479:x1875064681147776:12345-0@lo:502: Request processed in 198us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.442207:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201120.442395:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000396e4d5a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7479:1875064681147776:0@lo:502: 00000020:01000000:3.0:1788201120.442438:0:7479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201120.442454:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201120.442457:0:7479:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788201120.442462:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201120.442466:0:7479:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:3.0:1788201120.442501:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201120.442531:0:7479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000ee070f92) 00000020:00000080:3.0:1788201120.442557:0:7479:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788201120.442566:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201120.442662:0:7479:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788201120.442669:0:7479:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788201120.442675:0:7479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee4471ff6d 00010000:00080000:3.0:1788201120.442712:0:7479:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000049dbefc3@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1788201120.444687:0:7479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788201120.459519:0:7479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201120.459540:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788201120.459633:0:7479:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788201120.459663:0:7479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee4471ff74 00000100:00080000:1.0:1788201120.459676:0:7479:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201120.459683:0:7479:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000049dbefc3 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201120.459734:0:7479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000054e4b902 x1875064681147904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201120.460347:0:7479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788201120.460407:0:7479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788201120.460960:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681147904:0@lo:38: 00000100:00100000:0.0:1788201120.461053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.461344:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681147904 00000100:00100000:2.0:1788201120.461355:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681147904 00000100:00100000:2.0:1788201120.461394:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201120.461401:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef680cda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681147904:12345-0@lo:38: 00010000:00080000:2.0:1788201120.461857:0:6521:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1788201120.461929:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee4471ff7b 00000004:00100000:2.0:1788201120.461946:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788201120.461952:0:6521:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788201120.464427:0:7483:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000175cafc0 x1875064681148032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201120.464447:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set 000000008b61e61d going to sleep for 0 seconds 00000020:01000000:2.0:1788201120.470509:0:7479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201120.470521:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.470524:0:7479:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788201120.470528:0:7479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201120.470534:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.470535:0:7479:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201120.470539:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201120.470540:0:7479:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788201120.470647:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009a8bb063 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7479:1875064681148160:0@lo:502: 00000100:00100000:2.0:1788201120.470775:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.470834:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681148160 00000100:00100000:2.0:1788201120.470843:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681148160 00000100:00100000:2.0:1788201120.474437:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201120.474453:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033c98f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:7479:x1875064681148160:12345-0@lo:502: 00000100:00100000:2.0:1788201120.474725:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033c98f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:7479:x1875064681148160:12345-0@lo:502: Request processed in 274us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.474734:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201120.474889:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ac57289 going to sleep for 11 seconds 00000100:00100000:2.0:1788201120.474923:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009a8bb063 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:7479:1875064681148160:0@lo:502: 00000020:01000000:2.0:1788201120.474961:0:7479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201120.474970:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201120.474973:0:7479:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788201120.474977:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788201120.475704:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788201120.475734:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201120.475768:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000075f150c3/0xf9b71aee4471ff58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.475782:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000075f150c3/0xf9b71aee4471ff58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201120.475792:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788201120.475795:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ce0b2520000 from 1 10000000:01000000:0.0:1788201120.475799:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788201120.475839:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000e440f360/0xf9b71aee4471ff82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.475847:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000e440f360/0xf9b71aee4471ff82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.475858:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000e440f360/0xf9b71aee4471ff82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.475882:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681148288:0@lo:101: 00000100:00100000:0.0:1788201120.475934:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.475964:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 000000006da7cd9f going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.475996:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681148288 00000100:00100000:0.0:1788201120.476004:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681148288 00000100:00100000:0.0:1788201120.476053:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201120.476063:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000517c6354 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681148288:12345-0@lo:101: 00010000:00010000:0.0:1788201120.476076:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201120.476091:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000194bfa74/0xf9b71aee4471ff89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ff82 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.476119:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000194bfa74/0xf9b71aee4471ff89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.476130:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000194bfa74/0xf9b71aee4471ff89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.476140:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000194bfa74, rc 0) 00000100:00100000:0.0:1788201120.476175:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000517c6354 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681148288:12345-0@lo:101: Request processed in 116us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.476181:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201120.476218:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681148288:0@lo:101: 00010000:00010000:0.0:1788201120.476230:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000e440f360/0xf9b71aee4471ff82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.476277:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000e440f360/0xf9b71aee4471ff82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201120.476332:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681148416:0@lo:501: 00000100:00100000:0.0:1788201120.476356:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.476375:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 000000006da7cd9f going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.476386:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681148416 00000100:00100000:0.0:1788201120.476390:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681148416 00000100:00100000:0.0:1788201120.476411:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201120.476422:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a0cd79e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681148416:12345-0@lo:501: 00000100:00100000:0.0:1788201120.476490:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a0cd79e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681148416:12345-0@lo:501: Request processed in 68us (134us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201120.476496:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201120.476523:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681148416:0@lo:501: 10000000:01000000:0.0:1788201120.476543:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788201120.476547:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000e440f360/0xf9b71aee4471ff82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201120.476554:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000e440f360/0xf9b71aee4471ff82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201120.488063:0:6521:0:(import.c:65:import_set_state_nolock()) 00000000324561a3 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201120.488267:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef680cda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681147904:12345-0@lo:38: Request processed in 26853us (27202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.488278:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201120.488371:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201120.488391:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788201120.488402:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788201120.488410:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788201120.488413:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000049dbefc3 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788201120.488445:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008b61e61d): req@00000000175cafc0 x1875064681148032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201120.488471:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054e4b902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681147904:0@lo:38: 00000100:00100000:1.0:1788201120.488650:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009a8bb063 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681148544:0@lo:41: 00000100:00100000:1.0:1788201120.488720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.488954:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681148544 00000100:00100000:2.0:1788201120.488963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681148544 00000100:00100000:2.0:1788201120.489018:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201120.489045:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054e4b902 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681148544:12345-0@lo:41: 00000004:00000024:2.0:1788201120.489092:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788201120.489146:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054e4b902 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681148544:12345-0@lo:41: Request processed in 105us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.489154:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201120.489214:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.489246:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set 000000008b61e61d going to sleep for 11 seconds 00000100:00100000:2.0:1788201120.489307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681148032 00000100:00100000:2.0:1788201120.489314:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681148032 00000100:00100000:2.0:1788201120.489339:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201120.489345:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004113fba6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681148032:12345-0@lo:1000: 00000100:00100000:2.0:1788201120.489442:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004113fba6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681148032:12345-0@lo:1000: Request processed in 97us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.489453:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201120.489485:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000175cafc0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681148032:0@lo:1000: 00000040:01000000:3.0:1788201120.489551:0:7483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788201120.489561:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009a8bb063 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681148544:0@lo:41: 00000100:00100000:3.0:1788201120.489619:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000204bed20 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681148672:0@lo:1000: 00000100:00100000:3.0:1788201120.489658:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.489691:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set 0000000068181300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201120.489761:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681148672 00000100:00100000:2.0:1788201120.489767:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681148672 00000100:00100000:2.0:1788201120.490687:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201120.490701:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031e4f730 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681148672:12345-0@lo:1000: 00000100:00100000:2.0:1788201120.490910:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031e4f730 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681148672:12345-0@lo:1000: Request processed in 214us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201120.490917:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201120.491038:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000204bed20 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681148672:0@lo:1000: 00000100:00100000:3.0:1788201120.491109:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000204bed20 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681148800:0@lo:700: 00000100:00100000:3.0:1788201120.491153:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201120.492198:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d469b6e3 going to sleep for 11 seconds 00000100:00100000:3.0:1788201120.492232:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681148800 00000100:00100000:3.0:1788201120.492239:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681148800 00000100:00100000:3.0:1788201120.492302:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201120.492311:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0c15c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681148800:12345-0@lo:700: 00000100:00100000:3.0:1788201120.492395:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0c15c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681148800:12345-0@lo:700: Request processed in 86us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201120.492402:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201120.492441:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000204bed20 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681148800:0@lo:700: 00000100:00100000:3.0:1788201120.492682:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000204bed20 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681148928:0@lo:1000: 00000100:00100000:3.0:1788201120.492735:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201120.495853:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681148928 00000100:00100000:1.0:1788201120.495874:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681148928 00000100:00100000:1.0:1788201120.495962:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201120.495973:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f75e157 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681148928:12345-0@lo:1000: 00000100:00100000:3.0:1788201120.496006:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set 0000000068181300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.496174:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f75e157 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681148928:12345-0@lo:1000: Request processed in 200us (3436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201120.496195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201120.497005:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000204bed20 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681148928:0@lo:1000: 00000004:00080000:2.0:1788201120.497094:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d469b6e3 with version 0 00000020:00100000:2.0:1788201120.497123:0:7483:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201120.497131:0:7483:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009a8bb063 x1875064681149184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201120.497156:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009a8bb063 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681149184:0@lo:1000: 00000100:00100000:2.0:1788201120.497222:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201120.497270:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set 000000001a51d708 going to sleep for 11 seconds 00000100:00100000:1.0:1788201120.497542:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681149184 00000100:00100000:1.0:1788201120.497549:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681149184 00000100:00100000:1.0:1788201120.497602:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201120.497610:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000396e4d5a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7483:x1875064681149184:12345-0@lo:1000: 00000001:00080000:0.0:1788201120.508551:0:7447:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788201120.508567:0:7447:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201120.508706:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000396e4d5a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7483:x1875064681149184:12345-0@lo:1000: Request processed in 11093us (11481us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788201120.508725:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1788201120.508802:0:7483:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788201120.508807:0:7483:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788201120.508825:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009a8bb063 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681149184:0@lo:1000: 00000100:00100000:0.0:1788201120.509273:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681149312:0@lo:1000: 00000100:00100000:0.0:1788201120.509322:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.509350:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062cda250 going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.509371:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681149312 00000100:00100000:0.0:1788201120.509377:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681149312 00000100:00100000:0.0:1788201120.509416:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201120.509423:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000371d9702 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7483:x1875064681149312:12345-0@lo:1000: 00000100:00100000:0.0:1788201120.509498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000371d9702 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7483:x1875064681149312:12345-0@lo:1000: Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201120.509505:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201120.509533:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7483:1875064681149312:0@lo:1000: 00000040:00080000:0.0:1788201120.509550:0:7483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788201120.509580:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d469b6e3 with version 1 00000040:00080000:0.0:1788201120.513980:0:7483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201120.514151:0:7483:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788201120.514156:0:7483:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1788201120.514274:0:7481:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000bc43eaff version 1 rpc_version 1 00000020:00100000:0.0:1788201120.514317:0:7481:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201120.514328:0:7481:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004b6c3df7 x1875064681149568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201120.514354:0:7481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7481:1875064681149568:0@lo:1000: 00000100:00100000:0.0:1788201120.514432:0:7481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201120.514469:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set 000000006da7cd9f going to sleep for 11 seconds 00000100:00100000:0.0:1788201120.514492:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681149568 00000100:00100000:0.0:1788201120.514499:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681149568 00000100:00100000:0.0:1788201120.514543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201120.514552:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000622e0e8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7481:x1875064681149568:12345-0@lo:1000: 00000001:00080000:0.0:1788201120.532415:0:7447:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788201120.532566:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000622e0e8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7481:x1875064681149568:12345-0@lo:1000: Request processed in 18009us (18129us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788201120.532580:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1788201120.532638:0:7481:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788201120.532643:0:7481:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788201120.532660:0:7481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7481:1875064681149568:0@lo:1000: 00010000:00010000:1.0:1788201120.887087:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201121.909836:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201122.934957:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201123.967279:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201124.447380:0:7720:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201124.982923:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201125.475171:0:7773:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201125.476695:0:7773:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201125.494036:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201125.495092:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201125.495113:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681149824:0@lo:41: 00000100:00100000:1.0:1788201125.496127:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000503fbe20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681149696:0@lo:41: 00000100:00100000:1.0:1788201125.496183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201125.496284:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681149696 00000100:00100000:1.0:1788201125.496292:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681149696 00000100:00100000:1.0:1788201125.496339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201125.496347:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002259d3e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681149696:12345-0@lo:41: 00000004:00000024:1.0:1788201125.496385:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788201125.496426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002259d3e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681149696:12345-0@lo:41: Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201125.496434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201125.496471:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000503fbe20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681149696:0@lo:41: 00000100:00100000:0.0:1788201125.496562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201125.498769:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681149824 00000100:00100000:1.0:1788201125.498782:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681149824 00000100:00100000:1.0:1788201125.498838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201125.498847:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fde1602 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681149824:12345-0@lo:41: 00000100:00100000:2.0:1788201125.499869:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000314bc577 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681150080:0@lo:400: 00000100:00100000:2.0:1788201125.500028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201125.500066:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201125.500071:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000686f0179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681149952:0@lo:400: 00000100:00100000:2.0:1788201125.500100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201125.500138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681150080 00000100:00100000:2.0:1788201125.500143:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681150080 00000100:00100000:2.0:1788201125.500177:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201125.500184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052f6b09c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681150080:12345-0@lo:400: 00000100:00100000:2.0:1788201125.500243:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052f6b09c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681150080:12345-0@lo:400: Request processed in 59us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201125.500250:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788201125.500294:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000314bc577 x1875064681150080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201125.500307:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000314bc577 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681150080:0@lo:400: 00000004:00000024:0.0:1788201125.500766:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788201125.500811:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fde1602 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681149824:12345-0@lo:41: Request processed in 1966us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201125.500819:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201125.500845:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681149952 00000100:00100000:0.0:1788201125.500849:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681149952 00000100:00100000:0.0:1788201125.500945:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201125.500954:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cb2b171 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:3647:x1875064681149952:12345-0@lo:400: 00000100:00100000:0.0:1788201125.500988:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cb2b171 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:3647:x1875064681149952:12345-0@lo:400: Request processed in 37us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201125.500994:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201125.501028:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004d4c81d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681150208:0@lo:400: 00000100:00100000:0.0:1788201125.501055:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201125.501091:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b6c3df7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681149824:0@lo:41: 00000100:00100000:0.0:1788201125.501123:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681150208 00000100:00100000:0.0:1788201125.501127:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681150208 00000100:00100000:0.0:1788201125.501149:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201125.501154:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d34412fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681150208:12345-0@lo:400: 00000100:00100000:0.0:1788201125.501187:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d34412fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681150208:12345-0@lo:400: Request processed in 34us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201125.501194:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788201125.501231:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004d4c81d8 x1875064681150208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201125.501260:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004d4c81d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681150208:0@lo:400: 00000100:00100000:2.0:1788201125.502850:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000686f0179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681149952:0@lo:400: 00010000:00010000:1.0:1788201126.035859:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201127.101335:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201128.122475:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201128.616608:0:7874:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201128.617511:0:7874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201129.141957:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201129.806845:0:7922:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1069a830 20000000:00000080:1.0:1788201129.806869:0:7922:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce0ba044800 uarg=0000000000000000 20000000:01000000:1.0:1788201129.806932:0:7922:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788201129.806941:0:7922:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788201129.806949:0:7922:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788201129.807046:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788201129.807062:0:7922:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788201129.825656:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201129.826023:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788201129.826064:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788201129.826082:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788201129.826103:0:7922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788201129.826126:0:7922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201129.826159:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201129.826167:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201129.826175:0:7922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201129.826237:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201129.826253:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 17 pid: 6510 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201129.826270:0:7922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000686f0179 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1875064681150336:0@lo:104: 00000100:00100000:2.0:1788201129.826358:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201129.826426:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201129.826433:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 17 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201129.826442:0:7922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000314bc577 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1875064681150464:0@lo:104: 00000100:00100000:2.0:1788201129.826462:0:7922:0:(client.c:2702:ptlrpc_set_wait()) set 00000000503b676b going to sleep for 11 seconds 00000100:00100000:0.0:1788201129.827176:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201129.827214:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201129.827243:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681150336 00000100:00100000:0.0:1788201129.827251:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681150336 00000100:00100000:0.0:1788201129.827296:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681150464 00000100:00100000:0.0:1788201129.827299:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681150464 00000100:00100000:0.0:1788201129.827313:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201129.827321:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000211aabee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:7922:x1875064681150336:12345-0@lo:104: 00010000:00010000:0.0:1788201129.827337:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.827410:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201129.827415:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000211aabee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:7922:x1875064681150336:12345-0@lo:104: Request processed in 95us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201129.827422:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201129.827599:0:7922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000686f0179 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1875064681150336:0@lo:104: 00000100:00100000:0.0:1788201129.827638:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201129.827663:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b6c3df7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:7922:x1875064681150464:12345-0@lo:104: 00010000:00010000:0.0:1788201129.827682:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.827818:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201129.827825:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.827835:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008f30fe5 already unused, calling callback (00000000ee5bf388) 10000000:00010000:1.0:1788201129.827839:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.827847:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201129.827854:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201129.827859:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201129.827908:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.827915:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201129.827938:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.827945:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 0000000008f30fe5/0xf9b71aee4471fef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fefd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.827972:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201129.827974:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201129.827975:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201129.828004:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000503fbe20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681150592:0@lo:103: 00000100:00100000:1.0:1788201129.828048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201129.828120:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681150592 00000100:00100000:1.0:1788201129.828125:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681150592 00010000:00010000:1.0:1788201129.828151:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 18 pid: 6510 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201129.828182:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201129.828201:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b915623 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:3645:x1875064681150592:12345-0@lo:103: 00010000:00010000:1.0:1788201129.828213:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201129.828219:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 18 pid: 6510 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.828234:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 18 pid: 6510 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.828250:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3c18b6b/0xf9b71aee4471fefd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fef6 expref: 18 pid: 6510 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201129.828267:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201129.828309:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b915623 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:3645:x1875064681150592:12345-0@lo:103: Request processed in 120us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201129.828317:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788201129.828373:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201129.828381:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b6c3df7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:7922:x1875064681150464:12345-0@lo:104: Request processed in 727us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201129.828407:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201129.828442:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000503fbe20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681150592:0@lo:103: 00010000:00010000:0.0:1788201129.828457:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201129.828464:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.828474:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a7a588e9 already unused, calling callback (00000000ee5bf388) 10000000:00010000:0.0:1788201129.828478:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.828486:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201129.828493:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201129.828498:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201129.828544:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.828551:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201129.828577:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.828584:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 00000000a7a588e9/0xf9b71aee4471fe08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe0f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.828601:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201129.828602:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201129.828604:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201129.828610:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201129.828630:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000175cafc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681150720:0@lo:103: 00000100:00100000:0.0:1788201129.828672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201129.828703:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681150720 00000100:00100000:0.0:1788201129.828709:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681150720 00010000:00010000:0.0:1788201129.828731:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 17 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201129.828773:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201129.828779:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac7ccaba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:3647:x1875064681150720:12345-0@lo:103: 00010000:00010000:0.0:1788201129.829102:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201129.829108:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 17 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829120:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 17 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829138:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829146:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829160:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829166:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829172:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829178:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829201:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000395f2048 already unused, calling callback (00000000fc0d9d7c) 00010000:00010000:0.0:1788201129.829205:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829211:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829219:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201129.829229:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201129.829276:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac7ccaba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:3647:x1875064681150720:12345-0@lo:103: Request processed in 497us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201129.829283:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201129.829545:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000175cafc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681150720:0@lo:103: 00010000:00010000:3.0:1788201129.829624:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a9259932/0xf9b71aee4471fe0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fe08 expref: 16 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201129.829637:0:7922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000314bc577 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1875064681150464:0@lo:104: 00010000:00010000:3.0:1788201129.829656:0:7922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201129.829664:0:7922:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201129.829669:0:7922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201129.829681:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000395f2048/0xf9b71aee4471ff90 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201130.166214:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201130.614022:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681150976:0@lo:400: 00000100:00100000:1.0:1788201130.614078:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc6fb7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681151232:0@lo:400: 00000100:00100000:3.0:1788201130.614094:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201130.614135:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b53c8b74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681150848:0@lo:400: 00000100:00100000:2.0:1788201130.618019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201130.618129:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000503fbe20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681151360:0@lo:41: 00000100:00100000:2.0:1788201130.618166:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201130.618228:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681150976 00000100:00100000:2.0:1788201130.618236:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681150976 00000100:00100000:2.0:1788201130.618267:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681151360 00000100:00100000:2.0:1788201130.618269:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681151360 00000100:00100000:2.0:1788201130.618283:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201130.618290:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c372a49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681150976:12345-0@lo:400: 00000100:00100000:2.0:1788201130.618343:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c372a49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681150976:12345-0@lo:400: Request processed in 54us (4249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201130.618350:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201130.618366:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201130.618371:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c069c0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681151360:12345-0@lo:41: 00000004:00000024:2.0:1788201130.618397:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788201130.618429:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c069c0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681151360:12345-0@lo:41: Request processed in 58us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201130.618435:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201130.618900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000503fbe20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681151360:0@lo:41: 00000100:00100000:3.0:1788201130.619007:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084b17596 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681150976:0@lo:400: 00000100:00100000:3.0:1788201130.619025:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003d4dde7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681151488:0@lo:41: 00000100:00100000:3.0:1788201130.619054:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201130.619075:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201130.619081:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019b8a735 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681151104:0@lo:400: 00000100:00100000:1.0:1788201130.619826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201130.620923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201130.621157:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681151488 00000100:00100000:3.0:1788201130.621169:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681151488 00000100:00100000:3.0:1788201130.621212:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681151232 00000100:00100000:3.0:1788201130.621216:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681151232 00000100:00100000:3.0:1788201130.621231:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201130.621238:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084b17596 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681151488:12345-0@lo:41: 00000004:00000024:3.0:1788201130.621275:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788201130.621329:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084b17596 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681151488:12345-0@lo:41: Request processed in 90us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201130.621336:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201130.621352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201130.621357:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009de12f25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681151232:12345-0@lo:400: 00000100:00100000:3.0:1788201130.621399:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009de12f25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681151232:12345-0@lo:400: Request processed in 42us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201130.621420:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201130.621544:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003d4dde7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681151488:0@lo:41: 00000100:00100000:0.0:1788201130.621582:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681150848 00000100:00100000:0.0:1788201130.621587:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681150848 00000100:00100000:0.0:1788201130.622363:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681151104 00000100:00100000:0.0:1788201130.622369:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681151104 00000100:00100000:2.0:1788201130.622416:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201130.622424:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2a2482 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681150848:12345-0@lo:400: 00000100:00100000:2.0:1788201130.622494:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2a2482 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681150848:12345-0@lo:400: Request processed in 72us (4482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201130.622500:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201130.622515:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201130.622520:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f3e1d61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681151104:12345-0@lo:400: 00000100:00100000:2.0:1788201130.622561:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f3e1d61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681151104:12345-0@lo:400: Request processed in 41us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201130.622567:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788201130.622816:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b53c8b74 x1875064681150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201130.622830:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b53c8b74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681150848:0@lo:400: 00000100:00100000:1.0:1788201130.625601:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc6fb7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681151232:0@lo:400: 00010000:00080000:2.0:1788201130.626501:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000019b8a735 x1875064681151104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201130.626516:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019b8a735 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681151104:0@lo:400: 00010000:00010000:1.0:1788201131.189971:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201132.220395:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201133.238159:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201134.267801:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788201135.221852:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201135.221860:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce09e1da800 from 1 10000000:01000000:1.0:1788201135.221865:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201135.221920:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000514c95a3/0xf9b71aee4471ff97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201135.221934:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000514c95a3/0xf9b71aee4471ff97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201135.221953:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000514c95a3/0xf9b71aee4471ff97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201135.221978:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007eb10e51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681151616:0@lo:101: 00000100:00100000:1.0:1788201135.222059:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201135.222126:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e2d96735 going to sleep for 11 seconds 00000100:00100000:0.0:1788201135.222364:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681151616 00000100:00100000:0.0:1788201135.222373:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681151616 00000100:00100000:0.0:1788201135.222424:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201135.222433:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099732812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681151616:12345-0@lo:101: 00010000:00010000:0.0:1788201135.222446:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201135.222459:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091bb197a/0xf9b71aee4471ff9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ff97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201135.222482:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091bb197a/0xf9b71aee4471ff9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201135.222492:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091bb197a/0xf9b71aee4471ff9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201135.222514:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091bb197a, rc 0) 00000100:00100000:0.0:1788201135.222564:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099732812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681151616:12345-0@lo:101: Request processed in 132us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201135.222571:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201135.223135:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007eb10e51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681151616:0@lo:101: 00010000:00010000:1.0:1788201135.223159:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000514c95a3/0xf9b71aee4471ff97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201135.223168:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000514c95a3/0xf9b71aee4471ff97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201135.223338:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007eb10e51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681151744:0@lo:501: 00000100:00100000:1.0:1788201135.223376:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201135.223409:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e2d96735 going to sleep for 11 seconds 00000100:00100000:2.0:1788201135.223535:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681151744 00000100:00100000:2.0:1788201135.223541:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681151744 00000100:00100000:2.0:1788201135.223649:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201135.223658:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d60f0755 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681151744:12345-0@lo:501: 00000100:00100000:2.0:1788201135.224411:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d60f0755 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681151744:12345-0@lo:501: Request processed in 753us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201135.224420:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201135.224516:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007eb10e51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681151744:0@lo:501: 00000100:00100000:1.0:1788201135.224554:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007eb10e51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681151872:0@lo:503: 00000100:00100000:1.0:1788201135.224680:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201135.224721:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e2d96735 going to sleep for 11 seconds 00000100:00100000:2.0:1788201135.225096:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681151872 00000100:00100000:2.0:1788201135.225103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681151872 00000100:00100000:2.0:1788201135.225144:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201135.225162:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b17504e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681151872:12345-0@lo:503: 00000100:00100000:2.0:1788201135.225471:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b17504e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681151872:12345-0@lo:503: Request processed in 319us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201135.225478:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201135.225569:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007eb10e51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681151872:0@lo:503: 00000100:00100000:2.0:1788201135.226663:0:8187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c5c83a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8187:1875064681152000:0@lo:502: 00000100:00100000:2.0:1788201135.227117:0:8187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201135.227175:0:8187:0:(client.c:2702:ptlrpc_set_wait()) set 00000000911241a5 going to sleep for 11 seconds 00000100:00100000:1.0:1788201135.227278:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681152000 00000100:00100000:1.0:1788201135.227285:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681152000 00000100:00100000:1.0:1788201135.227423:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201135.227433:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b80f8d78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:8187:x1875064681152000:12345-0@lo:502: 00000100:00100000:1.0:1788201135.227556:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b80f8d78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:8187:x1875064681152000:12345-0@lo:502: Request processed in 124us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201135.227563:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201135.227650:0:8187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c5c83a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8187:1875064681152000:0@lo:502: 00000020:01000000:2.0:1788201135.227677:0:8187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201135.227693:0:8187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201135.227695:0:8187:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201135.227712:0:8187:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce09e1da800 00000020:00000080:2.0:1788201135.227716:0:8187:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201135.227796:0:8187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8187:1875064681152128:0@lo:502: 00000100:00100000:2.0:1788201135.227844:0:8187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201135.228465:0:8187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201135.228544:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681152128 00000100:00100000:0.0:1788201135.228550:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681152128 00000100:00100000:0.0:1788201135.228594:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201135.228603:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:8187:x1875064681152128:12345-0@lo:502: 00000100:00100000:0.0:1788201135.228849:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:8187:x1875064681152128:12345-0@lo:502: Request processed in 247us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201135.228857:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201135.229391:0:8187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8187:1875064681152128:0@lo:502: 00000020:01000000:2.0:1788201135.229428:0:8187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201135.229437:0:8187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201135.229439:0:8187:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788201135.229443:0:8187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788201135.230366:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788201135.230399:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201135.230412:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201135.230425:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201135.230437:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201135.230439:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0889be000 from 1 10000000:01000000:1.0:1788201135.230458:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201135.230495:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201135.230504:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201135.230515:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201135.230537:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681152256:0@lo:101: 00000100:00100000:1.0:1788201135.230670:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201135.230780:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b96d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201135.231444:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681152256 00000100:00100000:0.0:1788201135.231453:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681152256 00000100:00100000:0.0:1788201135.231508:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201135.231518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681152256:12345-0@lo:101: 00010000:00010000:0.0:1788201135.231533:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201135.231547:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ffa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201135.231572:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201135.232146:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201135.232169:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75200, rc 0) 00000100:00100000:0.0:1788201135.232365:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681152256:12345-0@lo:101: Request processed in 847us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201135.232385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201135.232464:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681152256:0@lo:101: 00010000:00010000:1.0:1788201135.232482:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201135.232492:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201135.232562:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681152384:0@lo:501: 00000100:00100000:1.0:1788201135.233640:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201135.233734:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b96d4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201135.234305:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681152384 00000100:00100000:3.0:1788201135.234314:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681152384 00000100:00100000:3.0:1788201135.234400:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201135.234410:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681152384:12345-0@lo:501: 00000100:00100000:3.0:1788201135.234562:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681152384:12345-0@lo:501: Request processed in 153us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.234569:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201135.234649:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681152384:0@lo:501: 00000100:00100000:2.0:1788201135.234691:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681152512:0@lo:503: 00000100:00100000:2.0:1788201135.234774:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201135.235389:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201135.235470:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681152512 00000100:00100000:1.0:1788201135.235476:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681152512 00000100:00100000:1.0:1788201135.235506:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201135.235513:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681152512:12345-0@lo:503: 00000100:00100000:1.0:1788201135.235660:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681152512:12345-0@lo:503: Request processed in 146us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201135.235677:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201135.236680:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681152512:0@lo:503: 00000100:00100000:0.0:1788201135.243939:0:8188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8188:1875064681152640:0@lo:502: 00000100:00100000:0.0:1788201135.244042:0:8188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201135.244089:0:8188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201135.247865:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681152640 00000100:00100000:1.0:1788201135.247881:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681152640 00000100:00100000:1.0:1788201135.247961:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201135.247971:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8188:x1875064681152640:12345-0@lo:502: 00000100:00100000:1.0:1788201135.248477:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8188:x1875064681152640:12345-0@lo:502: Request processed in 506us (4435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201135.248486:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201135.249845:0:8188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8188:1875064681152640:0@lo:502: 00000020:01000000:0.0:1788201135.249884:0:8188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201135.249893:0:8188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201135.249895:0:8188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201135.249906:0:8188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0889be000 00000020:00000080:0.0:1788201135.249909:0:8188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201135.249943:0:8188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8188:1875064681152768:0@lo:502: 00000100:00100000:0.0:1788201135.250101:0:8188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201135.250299:0:8188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201135.250337:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681152768 00000100:00100000:1.0:1788201135.250344:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681152768 00000100:00100000:1.0:1788201135.250431:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201135.250441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8188:x1875064681152768:12345-0@lo:502: 00000100:00100000:1.0:1788201135.250554:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8188:x1875064681152768:12345-0@lo:502: Request processed in 114us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201135.250561:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201135.250634:0:8188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8188:1875064681152768:0@lo:502: 00000020:01000000:0.0:1788201135.250654:0:8188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201135.250659:0:8188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201135.250661:0:8188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788201135.250666:0:8188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788201135.250929:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788201135.251028:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201135.251038:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201135.251050:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201135.287949:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201135.733940:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681153280:0@lo:400: 00000100:00100000:3.0:1788201135.734027:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201135.734083:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201135.734089:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681152896:0@lo:400: 00000100:00100000:3.0:1788201135.734119:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201135.734161:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681153408:0@lo:400: 00000100:00100000:3.0:1788201135.734191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201135.734223:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681153024:0@lo:400: 00000100:00100000:3.0:1788201135.734248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201135.734265:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681153536:0@lo:41: 00000100:00100000:3.0:1788201135.734287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201135.734302:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201135.734307:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681153152:0@lo:400: 00000100:00100000:3.0:1788201135.734334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201135.734343:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681153664:0@lo:41: 00000100:00100000:3.0:1788201135.734364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201135.734392:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681153280 00000100:00100000:3.0:1788201135.734397:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681153280 00000100:00100000:3.0:1788201135.734441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681153024 00000100:00100000:3.0:1788201135.734444:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681153024 00000100:00100000:3.0:1788201135.734463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201135.734473:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681153280:12345-0@lo:400: 00000100:00100000:3.0:1788201135.734526:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681153280:12345-0@lo:400: Request processed in 55us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.734534:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201135.734550:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201135.734557:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681153024:12345-0@lo:400: 00000100:00100000:3.0:1788201135.734590:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681153024:12345-0@lo:400: Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.734595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201135.734616:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681152896 00000100:00100000:3.0:1788201135.734619:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681152896 00000100:00100000:3.0:1788201135.734645:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201135.734651:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:3644:x1875064681152896:12345-0@lo:400: 00000100:00100000:3.0:1788201135.734682:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:3644:x1875064681152896:12345-0@lo:400: Request processed in 32us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.734687:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201135.734960:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681153408 00000100:00100000:3.0:1788201135.734964:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681153408 00000100:00100000:3.0:1788201135.734986:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681153536 00000100:00100000:3.0:1788201135.734994:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681153536 00000100:00100000:3.0:1788201135.735008:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681153152 00000100:00100000:3.0:1788201135.735010:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681153152 00000100:00100000:3.0:1788201135.735021:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681153664 00000100:00100000:3.0:1788201135.735023:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681153664 00000100:00100000:3.0:1788201135.735035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201135.735041:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681153408:12345-0@lo:400: 00000100:00100000:3.0:1788201135.735078:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681153408:12345-0@lo:400: Request processed in 36us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.735083:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201135.735096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201135.735102:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681153536:12345-0@lo:41: 00000004:00000024:3.0:1788201135.735127:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788201135.735168:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681153536:12345-0@lo:41: Request processed in 67us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.735175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201135.735186:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201135.735192:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681153152:12345-0@lo:400: 00000100:00100000:3.0:1788201135.735216:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681153152:12345-0@lo:400: Request processed in 25us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.735221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201135.735231:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201135.735236:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681153664:12345-0@lo:41: 00000004:00000024:3.0:1788201135.735251:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788201135.735278:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681153664:12345-0@lo:41: Request processed in 41us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.735283:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201135.735349:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681153152:0@lo:400: 00000100:00100000:3.0:1788201135.735364:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681153664:0@lo:41: 00010000:00080000:3.0:1788201135.735376:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0b94c4a80 x1875064681153024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201135.735385:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681153024:0@lo:400: 00000100:00100000:3.0:1788201135.735394:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681153536:0@lo:41: 00000100:00100000:3.0:1788201135.735445:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681152896:0@lo:400: 00000100:00100000:3.0:1788201135.735454:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681153408:0@lo:400: 00010000:00080000:3.0:1788201135.735463:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0b94c6680 x1875064681153280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201135.735473:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681153280:0@lo:400: 00010000:00010000:3.0:1788201136.312405:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201137.334101:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201138.362387:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201139.391287:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201139.988317:0:8423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201139.988323:0:8423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788201139.988324:0:8423:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788201139.988474:0:8423:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ce0b95bd800 00000020:01000004:3.0:1788201139.988493:0:8423:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788201139.989980:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788201139.990007:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ce0ba0f8000) 00000020:00000080:3.0:1788201139.990049:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788201140.084876:0:8423:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788201140.084995:0:8423:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788201140.148576:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201140.150490:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788201140.150514:0:8423:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201140.150530:0:8423:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf9b71aee4471ffba 00000020:01000004:3.0:1788201140.150553:0:8423:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788201140.150581:0:8423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201140.150586:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201140.150592:0:8423:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788201140.150597:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788201140.150613:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ce0ba0fb380) 00000020:00000080:3.0:1788201140.150635:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788201140.156074:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201140.159393:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788201140.159405:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788201140.160282:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788201140.160293:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788201140.162195:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201140.162211:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788201140.174043:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201140.174481:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788201140.174490:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788201140.176316:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788201140.176330:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788201140.213444:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201140.213722:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201140.213761:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788201140.218001:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788201140.218022:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788201140.220082:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201140.220099:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788201140.226873:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201140.227091:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788201140.227098:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788201140.229897:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788201140.230092:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788201140.292874:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201140.293102:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788201140.293110:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788201140.297872:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788201140.297898:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788201140.299347:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788201140.299385:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788201140.299394:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201140.330300:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201140.330359:0:8423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788201140.330364:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201140.330366:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201140.330367:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201140.330369:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201140.330370:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201140.330371:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201140.330377:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201140.330379:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201140.330380:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201140.330382:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201140.330383:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201140.330388:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788201140.330390:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201140.330392:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201140.330393:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201140.330394:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201140.330395:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201140.330396:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201140.330396:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201140.330397:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201140.330398:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201140.330399:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201140.330400:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201140.330586:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201140.330876:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681153792:0@lo:253: 00000100:00100000:0.0:1788201140.331157:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.331244:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.331438:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681153792 00000100:00100000:1.0:1788201140.331448:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681153792 00000100:00100000:1.0:1788201140.331517:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201140.331529:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8423:x1875064681153792:12345-0@lo:253: 20000000:01000000:1.0:1788201140.331568:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788201140.331573:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788201140.331580:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788201140.331584:0:6510:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788201140.333288:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201140.333458:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788201140.333475:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788201140.333490:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788201140.333495:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788201140.333506:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788201140.333518:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788201140.333612:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788201140.336020:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:0.0:1788201140.336024:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788201140.336085:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788201140.336093:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788201140.336109:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788201140.336125:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:0.0:1788201140.336141:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788201140.336149:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788201140.336193:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788201140.336211:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788201140.336359:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788201140.336371:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:0.0:1788201140.336373:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788201140.336387:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788201140.336393:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788201140.336406:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788201140.336411:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:0.0:1788201140.336423:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788201140.336428:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788201140.336439:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788201140.336452:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788201140.338236:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788201140.338284:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:0.0:1788201140.338287:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788201140.338303:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788201140.338310:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788201140.338322:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788201140.338328:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:0.0:1788201140.338341:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788201140.338348:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788201140.338360:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788201140.338374:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788201140.338387:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788201140.338391:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788201140.338395:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788201140.338445:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788201140.338448:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788201140.340493:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788201140.341470:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788201140.341512:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788201140.341550:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788201140.341566:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788201140.341569:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788201140.345289:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788201140.345356:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788201140.345383:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788201140.348091:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788201140.348140:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788201140.348155:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1788201140.348165:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788201140.348168:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788201140.352036:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788201140.352131:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788201140.352154:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788201140.352454:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788201140.352483:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788201140.352501:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788201140.352516:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788201140.352519:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788201140.354914:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788201140.354982:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788201140.355013:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788201140.355480:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788201140.355508:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788201140.355522:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:0.0:1788201140.355541:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788201140.355564:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355592:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a74c00/0xf9b71aee4471fe94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355600:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ff0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355606:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a74a00/0xf9b71aee4471ff43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355612:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081671e00/0xf9b71aee4471ff5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355618:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75800/0xf9b71aee4471ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355626:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355681:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75800/0xf9b71aee4471ff89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355696:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a75800/0xf9b71aee4471ff89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 18 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.355712:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681153920:0@lo:104: 00000100:00100000:0.0:1788201140.355822:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201140.355879:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081671e00/0xf9b71aee4471ff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355887:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081671e00/0xf9b71aee4471ff5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 18 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.355901:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681154048:0@lo:104: 00000100:00100000:0.0:1788201140.355924:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201140.355948:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a74a00/0xf9b71aee4471ff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.355956:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a74a00/0xf9b71aee4471ff43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 18 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.355964:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681154176:0@lo:104: 00000100:00100000:0.0:1788201140.355984:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201140.356012:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.356020:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 18 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.356028:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681154304:0@lo:104: 00000100:00100000:0.0:1788201140.356058:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201140.356075:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a74c00/0xf9b71aee4471fe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.356082:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a74c00/0xf9b71aee4471fe94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 18 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.356090:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681154432:0@lo:104: 00000100:00100000:0.0:1788201140.356109:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.356136:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201140.356225:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681153920 00000100:00100000:2.0:1788201140.356234:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681153920 00000100:00100000:2.0:1788201140.356274:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681154048 00000100:00100000:2.0:1788201140.356278:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681154048 00000100:00100000:2.0:1788201140.356291:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681154176 00000100:00100000:2.0:1788201140.356293:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681154176 00000100:00100000:2.0:1788201140.356302:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681154304 00000100:00100000:2.0:1788201140.356304:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681154304 00000100:00100000:2.0:1788201140.356312:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681154432 00000100:00100000:2.0:1788201140.356314:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681154432 00000100:00100000:2.0:1788201140.356327:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201140.356336:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+7:6510:x1875064681153920:12345-0@lo:104: 00010000:00010000:2.0:1788201140.356350:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee4471ff82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.356419:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201140.356426:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+7:6510:x1875064681153920:12345-0@lo:104: Request processed in 91us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.356434:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788201140.356435:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201140.356442:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee4471ff82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356451:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74800 already unused, calling callback (ffffffffc1519c20) 00000100:00100000:2.0:1788201140.356451:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 10000000:00010000:3.0:1788201140.356455:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee4471ff82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356464:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee4471ff82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201140.356472:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee4471ff82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.356472:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:6510:x1875064681154048:12345-0@lo:104: 10000000:01000000:3.0:1788201140.356479:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201140.356479:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee4471ff58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356512:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee4471ff82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.356516:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201140.356522:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:6510:x1875064681154048:12345-0@lo:104: Request processed in 51us (597us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201140.356524:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201140.356528:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201140.356539:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201140.356544:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:6510:x1875064681154176:12345-0@lo:104: 00010000:00010000:3.0:1788201140.356545:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee4471ff82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.356551:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee4471ff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356552:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee4471ff82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356565:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201140.356568:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee4471ff58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356574:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081671200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201140.356577:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee4471ff58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.356582:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788201140.356583:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee4471ff58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.356586:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:6510:x1875064681154176:12345-0@lo:104: Request processed in 42us (602us total) trans 0 rc 0/0 10000000:00010000:3.0:1788201140.356590:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee4471ff58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.356592:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:01000000:3.0:1788201140.356595:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788201140.356603:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201140.356608:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6510:x1875064681154304:12345-0@lo:104: 00010000:00010000:2.0:1788201140.356614:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee4471ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356619:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee4471ff58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356624:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201140.356629:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee4471ff58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356636:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee4471ff58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.356636:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201140.356640:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6510:x1875064681154304:12345-0@lo:104: Request processed in 33us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.356646:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788201140.356651:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201140.356654:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee4471ff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.356656:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788201140.356660:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75c00 already unused, calling callback (ffffffffc1519c20) 00000100:00100000:2.0:1788201140.356661:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6510:x1875064681154432:12345-0@lo:104: 10000000:00010000:3.0:1788201140.356663:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee4471ff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.356670:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee4471ff3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.356672:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee4471fe8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201140.356678:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee4471ff3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201140.356682:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201140.356696:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201140.356700:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6510:x1875064681154432:12345-0@lo:104: Request processed in 39us (591us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201140.356705:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee4471ff3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.356706:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788201140.356711:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201140.356726:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee4471ff3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.356732:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201140.356771:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681154816:0@lo:103: 00000100:00100000:2.0:1788201140.356801:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.356834:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681154816 00000100:00100000:2.0:1788201140.356838:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681154816 00010000:00010000:2.0:1788201140.356856:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a74a00/0xf9b71aee4471ff43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 19 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.356877:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201140.356883:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:3647:x1875064681154816:12345-0@lo:103: 00010000:00010000:2.0:1788201140.356894:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201140.356900:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a74a00/0xf9b71aee4471ff43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 19 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.356910:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a74a00/0xf9b71aee4471ff43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 19 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.356928:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201140.356955:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:3647:x1875064681154816:12345-0@lo:103: Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.356960:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201140.356999:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681154816:0@lo:103: 00010000:00010000:3.0:1788201140.357078:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee4471ff3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357089:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201140.357091:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee4471ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357106:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74600 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201140.357109:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee4471ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357111:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201140.357127:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee4471fe8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357128:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee4471ff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201140.357134:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee4471ff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357135:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201140.357138:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee4471fe8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201140.357140:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201140.357145:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee4471fe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201140.357151:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee4471fe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357155:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee4471ff04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201140.357157:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201140.357160:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201140.357170:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee4471fe8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357174:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee4471ff04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357176:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201140.357180:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee4471ff04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff0b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357180:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee4471fe8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357186:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee4471fe8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471fe94 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357190:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201140.357192:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201140.357193:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201140.357197:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201140.357199:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201140.357201:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201140.357211:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681154560:0@lo:103: 00000100:00100000:3.0:1788201140.357238:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.357273:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681155072:0@lo:103: 00000100:00100000:3.0:1788201140.357295:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.357320:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201140.357325:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681154688:0@lo:103: 00000100:00100000:3.0:1788201140.357343:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201140.357365:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201140.357371:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201140.357379:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681154944:0@lo:103: 00000100:00100000:3.0:1788201140.357404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.357424:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681154560 00000100:00100000:3.0:1788201140.357428:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681154560 00010000:00010000:3.0:1788201140.357444:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75800/0xf9b71aee4471ff89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 19 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.357456:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681155072 00000100:00100000:3.0:1788201140.357459:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681155072 00010000:00010000:3.0:1788201140.357470:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a74c00/0xf9b71aee4471fe94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 20 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201140.357470:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681154688 00000100:00100000:1.0:1788201140.357473:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681154688 00000100:00100000:3.0:1788201140.357480:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681154944 00000100:00100000:3.0:1788201140.357482:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681154944 00010000:00010000:1.0:1788201140.357487:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081671e00/0xf9b71aee4471ff5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 22 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357490:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ff0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 22 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.357500:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201140.357504:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788201140.357506:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3644:x1875064681154560:12345-0@lo:103: 00000100:00100000:1.0:1788201140.357511:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788201140.357512:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201140.357516:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75800/0xf9b71aee4471ff89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 22 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357524:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75800/0xf9b71aee4471ff89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 22 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357545:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201140.357546:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788201140.357554:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201140.357560:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3644:x1875064681155072:12345-0@lo:103: 00010000:00010000:1.0:1788201140.357567:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201140.357572:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a74c00/0xf9b71aee4471fe94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 22 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.357576:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3644:x1875064681154560:12345-0@lo:103: Request processed in 70us (337us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201140.357580:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a74c00/0xf9b71aee4471fe94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 22 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.357582:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788201140.357590:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201140.357594:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788201140.357599:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201140.357605:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3646:x1875064681154944:12345-0@lo:103: 00010000:00010000:3.0:1788201140.357612:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201140.357612:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3644:x1875064681155072:12345-0@lo:103: Request processed in 53us (317us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201140.357615:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ff0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 21 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201140.357618:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788201140.357623:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 21 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201140.357631:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788201140.357632:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201140.357636:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201140.357641:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:3644:x1875064681154688:12345-0@lo:103: 00010000:00010000:1.0:1788201140.357648:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201140.357652:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081671e00/0xf9b71aee4471ff5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 20 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.357653:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:3646:x1875064681154944:12345-0@lo:103: Request processed in 49us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.357659:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788201140.357661:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081671e00/0xf9b71aee4471ff5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 20 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357672:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.357681:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681154944:0@lo:103: 00010000:00010000:1.0:1788201140.357690:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357705:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357712:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357719:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.357721:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75800/0xf9b71aee4471ff89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ff82 expref: 19 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357727:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357732:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201140.357760:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357768:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357776:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.357787:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201140.357810:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:3644:x1875064681154688:12345-0@lo:103: Request processed in 168us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.357816:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201140.358034:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681154688:0@lo:103: 00000100:00100000:2.0:1788201140.358041:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681154560:0@lo:103: 00000100:00100000:2.0:1788201140.358048:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681155072:0@lo:103: 00000100:00100000:3.0:1788201140.358422:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681153920:0@lo:104: 00010000:00010000:3.0:1788201140.358439:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081671e00/0xf9b71aee4471ff5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ff58 expref: 17 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.358449:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681154048:0@lo:104: 00010000:00010000:3.0:1788201140.358468:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74a00/0xf9b71aee4471ff43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ff3c expref: 16 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.358476:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681154176:0@lo:104: 00010000:00010000:3.0:1788201140.358486:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ff0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ff04 expref: 15 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.358495:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681154304:0@lo:104: 00010000:00010000:3.0:1788201140.358503:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74c00/0xf9b71aee4471fe94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fe8d expref: 14 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.358510:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681154432:0@lo:104: 00010000:00010000:3.0:1788201140.358532:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.358541:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.358546:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.358552:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74000/0xf9b71aee4471ffc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201140.358564:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788201140.367863:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:8423:x1875064681153792:12345-0@lo:253: Request processed in 36322us (36693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.367881:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201140.368402:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681153792:0@lo:253: 10000000:01000000:0.0:1788201140.368442:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788201140.368446:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201140.368448:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201140.368449:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201140.368451:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788201140.368452:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201140.368454:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201140.368455:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201140.368457:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788201140.368459:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201140.368460:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201140.368485:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0b95bd800 from lustre-OST0000 10000000:01000000:0.0:1788201140.368523:0:8423:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788201140.368526:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201140.368537:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0b2520000 local copy 10000000:01000000:0.0:1788201140.368542:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788201140.368587:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.368600:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.368610:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.368632:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155200:0@lo:101: 00000100:00100000:0.0:1788201140.368677:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.368725:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201140.371232:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681155200 00000100:00100000:3.0:1788201140.371271:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681155200 00000100:00100000:3.0:1788201140.371346:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201140.371357:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+13:8423:x1875064681155200:12345-0@lo:101: 00010000:00010000:3.0:1788201140.371377:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201140.371399:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ffd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ffcf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.371429:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ffd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ffcf expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.371440:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ffd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ffcf expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.371451:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1c00, rc 0) 00000100:00100000:3.0:1788201140.371538:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:8423:x1875064681155200:12345-0@lo:101: Request processed in 184us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.371544:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201140.373054:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155200:0@lo:101: 00010000:00010000:0.0:1788201140.373087:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.373132:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.373288:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155328:0@lo:501: 00000100:00100000:0.0:1788201140.373350:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.373400:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201140.373619:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681155328 00000100:00100000:3.0:1788201140.373636:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681155328 00000100:00100000:3.0:1788201140.373689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788201140.373698:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:8423:x1875064681155328:12345-0@lo:501: 00000100:00100000:3.0:1788201140.374055:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:8423:x1875064681155328:12345-0@lo:501: Request processed in 356us (702us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201140.374063:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201140.374168:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155328:0@lo:501: 10000000:01000000:0.0:1788201140.374185:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788201140.374207:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788201140.374214:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.374223:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.374230:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.374254:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201140.374287:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0b95bd800 10000000:01000000:0.0:1788201140.374293:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201140.374299:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201140.374302:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201140.374307:0:8423:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788201140.374310:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201140.375137:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201140.375147:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.375156:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75a00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201140.375175:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.375185:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201140.375197:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201140.375203:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201140.375230:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.375236:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201140.375304:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681155584:0@lo:103: 00000100:00100000:1.0:1788201140.375367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.375454:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681155584 00000100:00100000:2.0:1788201140.375461:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681155584 00000100:00100000:2.0:1788201140.375513:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201140.375523:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:3645:x1875064681155584:12345-0@lo:103: 00010000:00010000:2.0:1788201140.375537:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201140.375554:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee4471ffd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4471ffcf expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.375577:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201140.375642:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.375649:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75a00/0xf9b71aee4471ffcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee4471ffd6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.375664:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201140.375666:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201140.375667:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201140.377504:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.377544:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.377558:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.377587:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155456:0@lo:101: 00000100:00100000:0.0:1788201140.377660:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.377783:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681155456 00000100:00100000:0.0:1788201140.377793:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201140.377794:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681155456 00000100:00100000:3.0:1788201140.377859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201140.377870:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:8423:x1875064681155456:12345-0@lo:101: 00010000:00010000:3.0:1788201140.377886:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201140.377902:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471ffdd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.377956:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.377968:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.377977:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1600, rc 0) 00000100:00100000:3.0:1788201140.378030:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681155456:12345-0@lo:101: Request processed in 162us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.378037:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201140.378350:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155456:0@lo:101: 00010000:00010000:0.0:1788201140.378367:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.378377:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.378487:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155712:0@lo:501: 00000100:00100000:0.0:1788201140.378517:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.378597:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201140.378630:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681155712 00000100:00100000:3.0:1788201140.378635:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681155712 00000100:00100000:3.0:1788201140.378770:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201140.378780:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681155712:12345-0@lo:501: 00000100:00100000:3.0:1788201140.378962:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681155712:12345-0@lo:501: Request processed in 183us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.378970:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201140.378996:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155712:0@lo:501: 00000100:00100000:3.0:1788201140.379024:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155840:0@lo:503: 00000100:00100000:3.0:1788201140.379068:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.379782:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.379938:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681155840 00000100:00100000:0.0:1788201140.379945:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681155840 00000100:00100000:0.0:1788201140.379981:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201140.379989:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681155840:12345-0@lo:503: 00000100:00100000:0.0:1788201140.380107:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681155840:12345-0@lo:503: Request processed in 118us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.380125:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201140.380279:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155840:0@lo:503: 00000040:00080000:3.0:1788201140.380571:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201140.380673:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155968:0@lo:502: 00000100:00100000:3.0:1788201140.380997:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.381073:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201140.381095:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681155968 00000100:00100000:3.0:1788201140.381100:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681155968 00000100:00100000:0.0:1788201140.381238:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788201140.381247:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681155968:12345-0@lo:502: 00000100:00100000:0.0:1788201140.381338:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681155968:12345-0@lo:502: Request processed in 93us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.381345:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201140.381468:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681155968:0@lo:502: 00000040:00080000:3.0:1788201140.381665:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788201140.381948:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788201140.381963:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788201140.381976:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788201140.381989:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788201140.382001:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788201140.382027:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156096:0@lo:502: 00000100:00100000:3.0:1788201140.382073:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.382158:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.382251:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681156096 00000100:00100000:0.0:1788201140.382257:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681156096 00000100:00100000:0.0:1788201140.382327:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788201140.382336:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156096:12345-0@lo:502: 00000100:00100000:0.0:1788201140.382430:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156096:12345-0@lo:502: Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.382436:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201140.383209:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156096:0@lo:502: 00000040:00080000:3.0:1788201140.383289:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788201140.383300:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788201140.384213:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201140.384224:0:8447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788201140.384232:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201140.384235:0:8447:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788201140.384241:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201140.384258:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ce0ba0fcd40) 00000020:00000080:3.0:1788201140.384285:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201140.384290:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201140.384379:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0b95bd800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788201140.384389:0:8447:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201140.384397:0:8447:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf9b71aee4471fff2 00000100:00100000:2.0:1788201140.385185:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:3645:x1875064681155584:12345-0@lo:103: Request processed in 9657us (9811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.385201:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201140.388036:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681155584:0@lo:103: 00010000:00010000:2.0:1788201140.396131:0:8447:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788201140.396482:0:8447:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788201140.407146:0:8447:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 00010000:00010000:1.0:1788201140.407166:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1788201140.409384:0:8447:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788201140.429654:0:8447:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788201140.432670:0:8447:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788201140.446044:0:8447:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788201140.451836:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788201140.451852:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201140.451860:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201140.451862:0:8447:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788201140.451865:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201140.451870:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201140.451871:0:8447:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201140.451874:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201140.451876:0:8447:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201140.452074:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201140.452080:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201140.452081:0:8447:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788201140.452085:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788201140.452359:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788201140.452399:0:8423:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201140.452431:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.452444:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201140.452453:0:8423:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b95bd800 from 1 10000000:01000000:3.0:1788201140.452456:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201140.452503:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.452511:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.452524:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.452552:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156224:0@lo:101: 00000100:00100000:3.0:1788201140.452649:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.452725:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.453207:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681156224 00000100:00100000:1.0:1788201140.453216:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681156224 00000100:00100000:1.0:1788201140.453274:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788201140.453285:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:8423:x1875064681156224:12345-0@lo:101: 00010000:00010000:1.0:1788201140.453301:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201140.453318:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4471fff9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.453349:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.453361:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.453370:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081671e00, rc 0) 00000100:00100000:1.0:1788201140.459967:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156224:12345-0@lo:101: Request processed in 6669us (7303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.459983:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201140.460620:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156224:0@lo:101: 00010000:00010000:3.0:1788201140.460653:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.460668:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.460980:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156352:0@lo:501: 00000100:00100000:3.0:1788201140.461060:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.461107:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.463134:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681156352 00000100:00100000:0.0:1788201140.463148:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681156352 00000100:00100000:0.0:1788201140.463214:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201140.463226:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156352:12345-0@lo:501: 00000100:00100000:0.0:1788201140.463449:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156352:12345-0@lo:501: Request processed in 225us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.463465:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788201140.463591:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156352:0@lo:501: 00000100:00100000:1.0:1788201140.463651:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156480:0@lo:503: 00000100:00100000:1.0:1788201140.463703:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.463759:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba330840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.465190:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681156480 00000100:00100000:0.0:1788201140.465204:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681156480 00000100:00100000:0.0:1788201140.465255:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201140.465265:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156480:12345-0@lo:503: 00000100:00100000:0.0:1788201140.465429:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156480:12345-0@lo:503: Request processed in 165us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.465436:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201140.465504:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156480:0@lo:503: 00000040:00080000:0.0:1788201140.467336:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201140.467461:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156608:0@lo:502: 00000100:00100000:0.0:1788201140.467555:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.467605:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0860b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.467708:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681156608 00000100:00100000:1.0:1788201140.467717:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681156608 00000100:00100000:1.0:1788201140.467808:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201140.467818:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156608:12345-0@lo:502: 00000100:00100000:1.0:1788201140.480431:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156608:12345-0@lo:502: Request processed in 12599us (12861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.480448:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201140.480691:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156608:0@lo:502: 00000040:00080000:3.0:1788201140.481254:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788201140.481297:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788201140.481348:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156736:0@lo:502: 00000100:00100000:3.0:1788201140.481431:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.481482:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.481555:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681156736 00000100:00100000:1.0:1788201140.481564:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681156736 00000100:00100000:1.0:1788201140.481630:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201140.481641:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156736:12345-0@lo:502: 00000100:00100000:1.0:1788201140.481800:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156736:12345-0@lo:502: Request processed in 161us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.481807:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201140.481966:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156736:0@lo:502: 00000040:00080000:3.0:1788201140.482016:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788201140.482025:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788201140.482734:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201140.482780:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201140.482783:0:8451:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201140.482791:0:8451:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0b95bd800 00000020:00000080:0.0:1788201140.482794:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201140.482811:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201140.482813:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201140.482815:0:8451:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788201140.482818:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788201140.483073:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788201140.483094:0:8423:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201140.483125:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.483137:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201140.483189:0:8423:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201140.483192:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0b95bd800 10000000:01000000:3.0:1788201140.483195:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0b95bd800 10000000:01000000:3.0:1788201140.483200:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201140.483206:0:8423:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0b95bd800 from 1 10000000:01000000:3.0:1788201140.483209:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201140.483245:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.483255:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.483280:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.483301:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156864:0@lo:101: 00000100:00100000:3.0:1788201140.483360:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.483403:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.483463:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681156864 00000100:00100000:1.0:1788201140.483471:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681156864 00000100:00100000:1.0:1788201140.483519:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201140.483530:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8423:x1875064681156864:12345-0@lo:101: 00010000:00010000:1.0:1788201140.483543:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201140.483557:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720007 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.483583:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720007 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.483594:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720007 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.483604:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081671200, rc 0) 00000100:00100000:1.0:1788201140.483884:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681156864:12345-0@lo:101: Request processed in 355us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.483897:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201140.485799:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156864:0@lo:101: 00010000:00010000:3.0:1788201140.485833:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.485847:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.486059:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156992:0@lo:501: 00000100:00100000:3.0:1788201140.486149:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.486200:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201140.486303:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681156992 00000100:00100000:2.0:1788201140.486311:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681156992 00000100:00100000:2.0:1788201140.486370:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201140.486382:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681156992:12345-0@lo:501: 00000100:00100000:2.0:1788201140.486523:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681156992:12345-0@lo:501: Request processed in 144us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.486547:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788201140.486694:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681156992:0@lo:501: 00000100:00100000:3.0:1788201140.486725:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681157120:0@lo:503: 00000100:00100000:3.0:1788201140.486789:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.488828:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.488937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681157120 00000100:00100000:1.0:1788201140.488947:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681157120 00000100:00100000:1.0:1788201140.489022:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201140.489033:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681157120:12345-0@lo:503: 00000100:00100000:1.0:1788201140.489243:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681157120:12345-0@lo:503: Request processed in 211us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.489250:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201140.489463:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681157120:0@lo:503: 00000040:00080000:3.0:1788201140.492604:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201140.494186:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681157248:0@lo:502: 00000100:00100000:3.0:1788201140.494304:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.494366:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.494731:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681157248 00000100:00100000:1.0:1788201140.494764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681157248 00000100:00100000:1.0:1788201140.494828:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201140.494840:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681157248:12345-0@lo:502: 00000100:00100000:1.0:1788201140.494999:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681157248:12345-0@lo:502: Request processed in 161us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.495007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788201140.496807:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681157248:0@lo:502: 00000040:00080000:3.0:1788201140.499391:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788201140.499466:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788201140.499483:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788201140.499497:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788201140.499511:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788201140.499525:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788201140.499539:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788201140.499553:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788201140.499568:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788201140.499602:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788201140.512085:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788201140.512170:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788201140.512186:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788201140.512199:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788201140.512213:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788201140.512228:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788201140.512242:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788201140.512259:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788201140.512272:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788201140.512287:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788201140.512303:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788201140.512318:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788201140.512333:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788201140.512351:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788201140.512367:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788201140.512381:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788201140.512396:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788201140.512410:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788201140.512424:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788201140.512439:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788201140.512454:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788201140.512468:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788201140.512482:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788201140.512496:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788201140.512510:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788201140.512525:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788201140.512539:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788201140.513058:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681157376:0@lo:502: 00000100:00100000:2.0:1788201140.513169:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.513276:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.518882:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681157376 00000100:00100000:0.0:1788201140.518901:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681157376 00000100:00100000:0.0:1788201140.519048:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788201140.519060:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681157376:12345-0@lo:502: 00000100:00100000:0.0:1788201140.519407:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681157376:12345-0@lo:502: Request processed in 348us (6237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.519424:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788201140.525036:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681157376:0@lo:502: 00000040:00080000:3.0:1788201140.525191:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788201140.525209:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788201140.542705:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788201140.542729:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ce0b97019c0) 00000020:00000080:2.0:1788201140.542779:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788201140.556830:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0b95bd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201140.556844:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0b95bd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201140.556849:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0b95bd800 3 00010000:00080000:1.0:1788201140.556894:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0aafdc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201140.558347:0:8452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788201140.558468:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788201140.558538:0:8452:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201140.558553:0:8452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf9b71aee4472001c 00000100:00080000:1.0:1788201140.558565:0:8452:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201140.558571:0:8452:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ce0aafdc800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201140.558613:0:8452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0834c9880 x1875064681157504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201140.558666:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1788201140.558936:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788201140.558961:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9cdf821d4d40) 00000020:00000080:1.0:1788201140.558975:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788201140.559100:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0b95bd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201140.559104:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0b95bd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201140.559107:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0b95bd800 3 00010000:00080000:1.0:1788201140.559150:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf821de000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.102@tcp at head 00000100:00100000:3.0:1788201140.560547:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681157632:0@lo:400: 00000100:00100000:3.0:1788201140.560633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.560700:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201140.560707:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681157760:0@lo:400: 00000100:00100000:3.0:1788201140.560735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.560799:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681157888:0@lo:400: 00000100:00100000:3.0:1788201140.560823:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.560846:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201140.560852:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681158016:0@lo:400: 00000100:00100000:3.0:1788201140.560873:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.560925:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681157632 00000100:00100000:3.0:1788201140.560934:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681157632 00000100:00100000:3.0:1788201140.560981:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681157888 00000100:00100000:3.0:1788201140.560984:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681157888 00000100:00100000:3.0:1788201140.561001:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201140.561025:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681157632:12345-0@lo:400: 00000100:00100000:3.0:1788201140.561087:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681157632:12345-0@lo:400: Request processed in 63us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.561094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201140.561126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201140.561133:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681157888:12345-0@lo:400: 00000100:00100000:3.0:1788201140.561163:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681157888:12345-0@lo:400: Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.561168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201140.561187:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681157760 00000100:00100000:3.0:1788201140.561191:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681157760 00000100:00100000:3.0:1788201140.561207:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681158016 00000100:00100000:3.0:1788201140.561209:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681158016 00000100:00100000:3.0:1788201140.561221:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201140.561227:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681157760:12345-0@lo:400: 00000100:00100000:3.0:1788201140.561259:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681157760:12345-0@lo:400: Request processed in 33us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.561266:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201140.561276:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201140.561281:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681158016:12345-0@lo:400: 00000100:00100000:3.0:1788201140.561307:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681158016:12345-0@lo:400: Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.561312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201140.561365:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681158016:0@lo:400: 00010000:00080000:3.0:1788201140.561382:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0ba3b1880 x1875064681157888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201140.561406:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681157888:0@lo:400: 00000100:00100000:3.0:1788201140.561440:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681157760:0@lo:400: 00010000:00080000:3.0:1788201140.561450:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0ba3b0380 x1875064681157632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201140.561460:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681157632:0@lo:400: 00000100:00100000:2.0:1788201140.565307:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681157504:0@lo:38: 00000100:00100000:2.0:1788201140.565402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.571011:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681157504 00000100:00100000:3.0:1788201140.571028:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681157504 00000100:00100000:3.0:1788201140.571097:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201140.571109:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681157504:12345-0@lo:38: 00010000:00080000:3.0:1788201140.571152:0:6517:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1788201140.571195:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf9b71aee4472002a 00000004:00100000:3.0:1788201140.571216:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201140.571257:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9cdf819d0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201140.571382:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875064681157504:12345-0@lo:38: Request processed in 275us (5979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.571390:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788201140.571452:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0834c9880 x1875064681157504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201140.571464:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201140.571475:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788201140.571483:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201140.571488:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201140.571490:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0aafdc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201140.571496:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681157504:0@lo:38: 00010000:00010000:1.0:1788201140.578585:0:8452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788201140.578717:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788201140.578792:0:8452:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201140.578808:0:8452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf9b71aee44720031 00000100:00080000:1.0:1788201140.578822:0:8452:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201140.578829:0:8452:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cdf821de000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201140.578875:0:8452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0834c8380 x1875064681158144/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201140.581146:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788201140.582157:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681158144:0@lo:38: 00000100:00100000:0.0:1788201140.582269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.584881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681158144 00000100:00100000:1.0:1788201140.584899:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681158144 00000100:00100000:1.0:1788201140.584979:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201140.584991:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875064681158144:12345-0@lo:38: 00010000:00080000:1.0:1788201140.585031:0:6516:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:1.0:1788201140.585101:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf9b71aee44720038 00000004:00100000:1.0:1788201140.585132:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201140.585176:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9cdf821db800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201140.585281:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875064681158144:12345-0@lo:38: Request processed in 291us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.585296:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788201140.585359:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0834c8380 x1875064681158144/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201140.585372:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201140.585382:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788201140.585390:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788201140.585396:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788201140.585398:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821de000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201140.585405:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681158144:0@lo:38: 00000040:00080000:1.0:1788201140.585536:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788201140.585707:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788201140.585766:0:8423:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201140.585780:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.585792:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201140.585843:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201140.585846:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201140.585847:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201140.585848:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201140.585850:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201140.585851:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201140.585853:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201140.585855:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201140.585856:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201140.585858:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201140.585859:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201140.585864:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788201140.585870:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201140.585872:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201140.585872:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201140.585873:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201140.585874:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201140.585875:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201140.585876:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201140.585877:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201140.585878:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201140.585879:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201140.585880:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201140.585903:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201140.585922:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681158272:0@lo:253: 00000100:00100000:1.0:1788201140.585975:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.586011:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.587686:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681158272 00000100:00100000:1.0:1788201140.587698:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681158272 00000100:00100000:1.0:1788201140.587774:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201140.587785:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681158272:12345-0@lo:253: 20000000:01000000:1.0:1788201140.587822:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201140.587838:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201140.607224:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201140.607243:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788201140.607526:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:8423:x1875064681158272:12345-0@lo:253: Request processed in 19736us (21542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.607541:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 20000000:01000000:3.0:1788201140.607800:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201140.607806:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201140.607831:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.607848:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a74400/0xf9b71aee4471ff35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.607857:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75e00/0xf9b71aee4471ff51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.607865:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.607925:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75e00/0xf9b71aee4471ff51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.607940:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a75e00/0xf9b71aee4471ff51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 15 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.607955:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681158400:0@lo:104: 00000100:00100000:3.0:1788201140.608000:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201140.608052:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a74400/0xf9b71aee4471ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.608061:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a74400/0xf9b71aee4471ff35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 15 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.608069:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681158528:0@lo:104: 00000100:00100000:3.0:1788201140.608091:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201140.608206:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201140.608222:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.608249:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681158400 00000100:00100000:2.0:1788201140.608257:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681158400 00000100:00100000:2.0:1788201140.608292:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681158528 00000100:00100000:2.0:1788201140.608294:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681158528 00000100:00100000:2.0:1788201140.608305:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201140.608312:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0c1d79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6531:x1875064681158400:12345-0@lo:104: 00010000:00010000:2.0:1788201140.608327:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4471ff4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608373:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201140.608379:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0c1d79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6531:x1875064681158400:12345-0@lo:104: Request processed in 68us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.608386:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201140.608418:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201140.608423:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6531:x1875064681158528:12345-0@lo:104: 00010000:00010000:2.0:1788201140.608430:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045c00/0xf9b71aee4471ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608466:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201140.608471:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6531:x1875064681158528:12345-0@lo:104: Request processed in 48us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.608476:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788201140.608492:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201140.608498:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4471ff4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608506:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2045000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201140.608510:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4471ff4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608520:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4471ff4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201140.608527:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4471ff4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201140.608532:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201140.608564:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4471ff4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608570:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201140.608592:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4471ff4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608599:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4471ff4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608626:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201140.608630:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045c00/0xf9b71aee4471ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608636:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2045c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201140.608639:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045c00/0xf9b71aee4471ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608646:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045c00/0xf9b71aee4471ff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201140.608652:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045c00/0xf9b71aee4471ff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201140.608657:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201140.608671:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045c00/0xf9b71aee4471ff2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608676:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201140.608682:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045c00/0xf9b71aee4471ff2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608688:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045c00/0xf9b71aee4471ff2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff35 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.608703:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201140.608704:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201140.608706:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201140.608714:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201140.608770:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681158784:0@lo:103: 00000100:00100000:2.0:1788201140.608802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.608834:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201140.608840:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681158656:0@lo:103: 00000100:00100000:2.0:1788201140.608861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.608902:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681158400:0@lo:104: 00000100:00100000:2.0:1788201140.608922:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681158528:0@lo:104: 00010000:00010000:2.0:1788201140.608943:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201140.609109:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8423:1875064681158272:0@lo:253: 10000000:01000000:1.0:1788201140.609132:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788201140.609135:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201140.609137:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201140.609138:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201140.609140:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201140.609141:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201140.609142:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201140.609144:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201140.609145:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201140.609147:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201140.609149:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201140.609150:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201140.609161:0:8423:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788201140.611025:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681158784 00000100:00100000:0.0:1788201140.611041:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681158784 00010000:00010000:0.0:1788201140.611089:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a74400/0xf9b71aee4471ff35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 16 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.611184:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681158656 00000100:00100000:0.0:1788201140.611188:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681158656 00010000:00010000:0.0:1788201140.611201:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75e00/0xf9b71aee4471ff51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 17 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201140.613667:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201140.613705:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:3647:x1875064681158784:12345-0@lo:103: 00010000:00010000:3.0:1788201140.613730:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201140.613756:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a74400/0xf9b71aee4471ff35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 17 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.613773:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a74400/0xf9b71aee4471ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 17 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.613797:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74400/0xf9b71aee4471ff35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ff2e expref: 17 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.613817:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201140.613917:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:3647:x1875064681158784:12345-0@lo:103: Request processed in 237us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.613926:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201140.613955:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201140.613962:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3647:x1875064681158656:12345-0@lo:103: 00010000:00010000:3.0:1788201140.613971:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201140.613975:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75e00/0xf9b71aee4471ff51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 15 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.613984:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75e00/0xf9b71aee4471ff51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 15 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.613993:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75e00/0xf9b71aee4471ff51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ff4a expref: 15 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614004:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614036:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201140.614055:0:8446:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016838863s 00010000:00010000:3.0:1788201140.614060:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614066:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614073:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614080:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614087:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201140.614092:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614100:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614127:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201140.614139:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201140.614166:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:3647:x1875064681158656:12345-0@lo:103: Request processed in 204us (5303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.614172:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00080000:10000000:1.0:1788201140.618902:0:8423:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788201140.619077:0:8423:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788201140.619288:0:8423:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788201140.619429:0:8423:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788201140.619636:0:8423:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788201140.619863:0:8423:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788201140.620653:0:8423:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788201140.620911:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681158656:0@lo:103: 00000100:00100000:1.0:1788201140.620926:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681158784:0@lo:103: 00010000:00010000:1.0:1788201140.620976:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.620989:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.620997:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a0400/0xf9b71aee4472003f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788201140.634542:0:8423:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788201140.634553:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788201140.634594:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201140.634686:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201140.634708:0:8423:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788201140.634847:0:8423:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788201140.635906:0:8423:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201140.636195:0:8423:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788201140.854480:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681158912:0@lo:41: 00000100:00100000:3.0:1788201140.854583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.855018:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201140.855027:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681159040:0@lo:41: 00000100:00100000:3.0:1788201140.855055:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201140.855106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681158912 00000100:00100000:3.0:1788201140.855127:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681158912 00000100:00100000:3.0:1788201140.855167:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681159040 00000100:00100000:3.0:1788201140.855170:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681159040 00000100:00100000:3.0:1788201140.855186:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201140.855196:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681158912:12345-0@lo:41: 00000004:00000024:3.0:1788201140.855243:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788201140.855291:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681158912:12345-0@lo:41: Request processed in 97us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.855299:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201140.855318:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201140.855325:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681159040:12345-0@lo:41: 00000004:00000024:3.0:1788201140.855343:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788201140.855370:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681159040:12345-0@lo:41: Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.855375:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201140.857483:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681159040:0@lo:41: 00000100:00100000:3.0:1788201140.857647:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681158912:0@lo:41: 10000000:01000000:0.0:1788201140.881251:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201140.881262:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce09e1da800 from 30 10000000:01000000:0.0:1788201140.881268:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201140.881325:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.881338:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.881352:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.881380:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159168:0@lo:101: 00000100:00100000:0.0:1788201140.881458:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.881522:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.881547:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681159168 00000100:00100000:0.0:1788201140.881553:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681159168 00000100:00100000:0.0:1788201140.881726:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201140.881770:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:6513:x1875064681159168:12345-0@lo:101: 00010000:00010000:0.0:1788201140.881786:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201140.881800:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720046 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.881827:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720046 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.882038:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720046 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.882049:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75800, rc 0) 00000100:00100000:0.0:1788201140.882092:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681159168:12345-0@lo:101: Request processed in 357us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.882099:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201140.882249:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159168:0@lo:101: 00010000:00010000:0.0:1788201140.882266:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.882276:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.882336:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159296:0@lo:501: 00000100:00100000:0.0:1788201140.882360:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.882375:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.882388:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681159296 00000100:00100000:0.0:1788201140.882391:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681159296 00000100:00100000:0.0:1788201140.882411:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201140.882423:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681159296:12345-0@lo:501: 00000100:00100000:0.0:1788201140.885432:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681159296:12345-0@lo:501: Request processed in 2994us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.885449:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201140.885815:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159296:0@lo:501: 00000100:00100000:1.0:1788201140.885894:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159424:0@lo:503: 00000100:00100000:1.0:1788201140.886273:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.886325:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.887383:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681159424 00000100:00100000:1.0:1788201140.887397:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681159424 00000100:00100000:1.0:1788201140.887456:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201140.887467:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681159424:12345-0@lo:503: 00000100:00100000:1.0:1788201140.888246:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681159424:12345-0@lo:503: Request processed in 777us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.888256:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201140.888326:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159424:0@lo:503: 00000100:00100000:1.0:1788201140.893843:0:8471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8471:1875064681159552:0@lo:502: 00000100:00100000:1.0:1788201140.895168:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.895219:0:8471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba266e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.895549:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681159552 00000100:00100000:0.0:1788201140.895560:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681159552 00000100:00100000:0.0:1788201140.895632:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201140.895643:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8471:x1875064681159552:12345-0@lo:502: 00000100:00100000:0.0:1788201140.898138:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8471:x1875064681159552:12345-0@lo:502: Request processed in 2486us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.898152:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201140.898438:0:8471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8471:1875064681159552:0@lo:502: 00000100:00100000:1.0:1788201140.898540:0:8471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8471:1875064681159680:0@lo:502: 00000100:00100000:1.0:1788201140.898592:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.898634:0:8471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba266e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.899211:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681159680 00000100:00100000:0.0:1788201140.899220:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681159680 00000100:00100000:0.0:1788201140.899276:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201140.899288:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8471:x1875064681159680:12345-0@lo:502: 00000100:00100000:0.0:1788201140.899409:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:8471:x1875064681159680:12345-0@lo:502: Request processed in 123us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.899416:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201140.900080:0:8471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8471:1875064681159680:0@lo:502: 00000040:00080000:1.0:1788201140.900129:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788201140.900453:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788201140.900478:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201140.900490:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.900515:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201140.900527:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201140.900530:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce09e1da800 from 5 10000000:01000000:0.0:1788201140.900544:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201140.900583:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.900592:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.900603:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.900623:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159808:0@lo:101: 00000100:00100000:0.0:1788201140.900679:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.902156:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681159808 00000100:00100000:1.0:1788201140.902169:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681159808 00000100:00100000:1.0:1788201140.902231:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201140.902243:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681159808:12345-0@lo:101: 00010000:00010000:1.0:1788201140.902264:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201140.902285:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720054 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.902326:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720054 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.902338:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720054 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.902348:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081670c00, rc 0) 00000100:00100000:1.0:1788201140.902421:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681159808:12345-0@lo:101: Request processed in 181us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.902427:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788201140.903222:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.903261:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159808:0@lo:101: 00010000:00010000:0.0:1788201140.903284:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.903297:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.903378:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159936:0@lo:256: 00000100:00100000:0.0:1788201140.903441:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.903484:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.903521:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681159936 00000100:00100000:0.0:1788201140.903526:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681159936 00000100:00100000:0.0:1788201140.903567:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201140.903575:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681159936:12345-0@lo:256: 20000000:01000000:0.0:1788201140.903595:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201140.903616:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201140.903623:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788201140.903706:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681159936:12345-0@lo:256: Request processed in 130us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.903713:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201140.903785:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681159936:0@lo:256: 10000000:01000000:0.0:1788201140.903842:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201140.903850:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.903859:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201140.903869:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788201140.903871:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788201140.903875:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201140.903900:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.906615:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.906635:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.906666:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681160064:0@lo:101: 00000100:00100000:0.0:1788201140.907499:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.909041:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201140.913452:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681160064 00000100:00100000:2.0:1788201140.913473:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681160064 00000100:00100000:2.0:1788201140.913578:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201140.913591:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681160064:12345-0@lo:101: 00010000:00010000:2.0:1788201140.913613:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201140.913637:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720062 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.913672:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720062 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.913685:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720062 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.913696:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0c2045c00, rc 0) 00000100:00100000:2.0:1788201140.913841:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681160064:12345-0@lo:101: Request processed in 253us (6345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.913857:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788201140.915433:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681160064:0@lo:101: 00010000:00010000:0.0:1788201140.915468:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.915495:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.915606:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681160192:0@lo:501: 00000100:00100000:0.0:1788201140.915675:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.917317:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681160192 00000100:00100000:2.0:1788201140.917334:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681160192 00000100:00100000:2.0:1788201140.917401:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201140.917415:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681160192:12345-0@lo:501: 00000100:00100000:2.0:1788201140.917619:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681160192:12345-0@lo:501: Request processed in 207us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.917627:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788201140.919042:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.919413:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681160192:0@lo:501: 00000100:00100000:0.0:1788201140.919471:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681160320:0@lo:503: 00000100:00100000:0.0:1788201140.919551:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.919598:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.923553:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681160320 00000100:00100000:1.0:1788201140.923573:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681160320 00000100:00100000:1.0:1788201140.923647:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201140.923660:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681160320:12345-0@lo:503: 00000100:00100000:1.0:1788201140.924242:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681160320:12345-0@lo:503: Request processed in 582us (4688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.924251:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201140.926179:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681160320:0@lo:503: 00000100:00100000:0.0:1788201140.929028:0:8472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8472:1875064681160448:0@lo:502: 00000100:00100000:0.0:1788201140.929168:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.929225:0:8472:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201140.931482:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681160448 00000100:00100000:0.0:1788201140.931498:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681160448 00000100:00100000:0.0:1788201140.931581:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788201140.931591:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:8472:x1875064681160448:12345-0@lo:502: 00000100:00100000:0.0:1788201140.933044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:8472:x1875064681160448:12345-0@lo:502: Request processed in 1444us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.933059:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201140.944381:0:8472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8472:1875064681160448:0@lo:502: 00000020:01000000:1.0:1788201140.944972:0:8472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201140.944982:0:8472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788201140.944991:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201140.944994:0:8472:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788201140.944999:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201140.945004:0:8472:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:1.0:1788201140.945035:0:8472:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788201140.945039:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201140.945057:0:8472:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9cdf821d19c0) 00000020:00000080:1.0:1788201140.945092:0:8472:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788201140.945098:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201140.945212:0:8472:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788201140.945220:0:8472:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788201140.945227:0:8472:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44720077 00010000:00080000:1.0:1788201140.945418:0:8472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf821db000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201140.946472:0:8472:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788201140.967967:0:8472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788201140.968004:0:8472:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788201140.968282:0:8472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201140.969077:0:8472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201140.969210:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788201140.969315:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788201140.971242:0:8474:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201140.971249:0:8474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788201140.975520:0:8472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788201140.975539:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201140.975593:0:8472:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788201140.975621:0:8472:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee4472007e 00000100:00080000:2.0:1788201140.975634:0:8472:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201140.975641:0:8472:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9cdf821db000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201140.975683:0:8472:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce09e1c4a80 x1875064681160576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201140.976034:0:8472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788201140.976100:0:8472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201140.976104:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201140.976107:0:8472:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788201140.976119:0:8472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201140.976125:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201140.976126:0:8472:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201140.976129:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201140.976132:0:8472:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788201140.976166:0:8472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8472:1875064681160704:0@lo:502: 00000100:00100000:2.0:1788201140.976982:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.977041:0:8472:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.977278:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681160576:0@lo:8: 00000100:00100000:1.0:1788201140.977338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.977410:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681160704 00000100:00100000:1.0:1788201140.977418:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681160704 00000100:00100000:1.0:1788201140.977478:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201140.977490:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:8472:x1875064681160704:12345-0@lo:502: 00000100:00100000:2.0:1788201140.977836:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681160576 00000100:00100000:2.0:1788201140.977841:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681160576 00000100:00100000:2.0:1788201140.977873:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201140.977879:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875064681160576:12345-0@lo:8: 00010000:00080000:2.0:1788201140.977908:0:8430:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1788201140.977940:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44720085 00002000:00100000:2.0:1788201140.977985:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9cdf82086000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788201140.977992:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788201140.977997:0:8430:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788201140.978075:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788201140.978150:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:8472:x1875064681160704:12345-0@lo:502: Request processed in 662us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.978160:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00002000:00080000:2.0:1788201140.978351:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788201140.978380:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9cdf82085800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201140.978434:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681160576:12345-0@lo:8: Request processed in 554us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201140.978442:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201140.978476:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce09e1c4a80 x1875064681160576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201140.978489:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788201140.978496:0:8472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8472:1875064681160704:0@lo:502: 00000100:00080000:1.0:1788201140.978498:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788201140.978510:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201140.978524:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788201140.978527:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821db000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000020:01000000:2.0:1788201140.978539:0:8472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201140.978547:0:8472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201140.978551:0:8472:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000004:00080000:1.0:1788201140.978553:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000040:00080000:2.0:1788201140.978556:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1788201140.978562:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681160576:0@lo:8: 00000020:01000000:1.0:1788201140.979040:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788201140.979067:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788201140.979077:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.979090:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201140.979102:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201140.979105:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0889be000 from 30 10000000:01000000:1.0:1788201140.979108:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201140.979156:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.979165:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.979176:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201140.979198:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681160832:0@lo:101: 00000100:00100000:1.0:1788201140.979234:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.979266:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba266240 going to sleep for 11 seconds 00000004:00080000:1.0:1788201140.981055:0:8474:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788201140.981063:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681160960:0@lo:400: 00000100:00100000:0.0:1788201140.981137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201140.981159:0:8474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 221278419446ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201140.981169:0:8474:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788201140.981186:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201140.981203:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681161088:0@lo:400: 00000100:00100000:0.0:1788201140.981230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.981271:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681161216:0@lo:400: 00000100:00100000:0.0:1788201140.981301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.981323:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201140.981329:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681161344:0@lo:400: 00000100:00100000:1.0:1788201140.981330:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681160960 00000100:00100000:1.0:1788201140.981340:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681160960 00000100:00100000:0.0:1788201140.981358:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.981389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681161088 00000100:00100000:0.0:1788201140.981394:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681161088 00000100:00100000:1.0:1788201140.981395:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681161216 00000100:00100000:1.0:1788201140.981400:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681161216 00000100:00100000:0.0:1788201140.981421:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681161344 00000100:00100000:0.0:1788201140.981426:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681161344 00000100:00100000:1.0:1788201140.981437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201140.981451:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681160960:12345-0@lo:400: 00000100:00100000:0.0:1788201140.981453:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201140.981463:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788201140.981879:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201140.981889:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201140.981897:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681161088:12345-0@lo:400: 00000100:00100000:0.0:1788201140.981939:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681161088:12345-0@lo:400: Request processed in 43us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.981947:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201140.981965:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201140.981971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201140.981977:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681161216:12345-0@lo:400: 00000100:00100000:0.0:1788201140.982008:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681161216:12345-0@lo:400: Request processed in 31us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.982014:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201140.982025:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201140.982029:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201140.982035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681161344:12345-0@lo:400: 00000100:00100000:0.0:1788201140.982074:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681161344:12345-0@lo:400: Request processed in 39us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.982081:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788201140.982101:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201140.982107:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201140.982304:0:8475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8475:1875064681161472:0@lo:700: 00000100:00100000:2.0:1788201140.982342:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.982376:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681161472 00000100:00100000:2.0:1788201140.982380:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681161472 00000100:00100000:2.0:1788201140.982538:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201140.982546:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8475:x1875064681161472:12345-0@lo:700: 00000100:00100000:2.0:1788201140.982576:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1875064681161600:0@lo:700: 00000100:00100000:2.0:1788201140.982604:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.982630:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201140.982646:0:8475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990480 going to sleep for 11 seconds 00000100:00080000:0.0:1788201140.982679:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201140.982694:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681161600 00000100:00100000:0.0:1788201140.982698:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681161600 00000100:00100000:0.0:1788201140.982728:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201140.982735:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1875064681161600:12345-0@lo:700: 00000100:00100000:0.0:1788201140.982876:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681160832 00000100:00100000:0.0:1788201140.982881:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681160832 00000100:00100000:0.0:1788201140.982909:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788201140.982916:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681160832:12345-0@lo:101: 00010000:00010000:0.0:1788201140.982927:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201140.982950:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472008c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.982978:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472008c expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.982992:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472008c expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.983003:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75400, rc 0) 00000100:00100000:0.0:1788201140.983042:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681160832:12345-0@lo:101: Request processed in 126us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.983048:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788201140.983104:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681160832:0@lo:101: 00010000:00010000:0.0:1788201140.983141:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201140.983151:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201140.983217:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681161728:0@lo:501: 00000100:00100000:0.0:1788201140.983245:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.983284:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4d80 going to sleep for 11 seconds 00010000:00080000:0.0:1788201140.983546:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f480 x1875064681161344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201140.983560:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681161344:0@lo:400: 00010000:00080000:0.0:1788201140.983572:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198d500 x1875064681161216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201140.983582:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681161216:0@lo:400: 00000100:00100000:0.0:1788201140.983834:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681161728 00000100:00100000:0.0:1788201140.983839:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681161728 00000100:00100000:0.0:1788201140.983871:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201140.983878:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681161728:12345-0@lo:501: 00000100:00100000:0.0:1788201140.984011:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681161728:12345-0@lo:501: Request processed in 133us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.984018:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201140.984055:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681161728:0@lo:501: 00000100:00100000:0.0:1788201140.984089:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681161856:0@lo:503: 00000100:00100000:0.0:1788201140.984143:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.984171:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4d80 going to sleep for 11 seconds 00010000:00080000:0.0:1788201140.984197:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198dc00 x1875064681161088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201140.984208:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681161088:0@lo:400: 00010000:00080000:0.0:1788201140.984220:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f800 x1875064681160960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201140.984227:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681160960:0@lo:400: 00000100:00100000:0.0:1788201140.984425:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681161856 00000100:00100000:0.0:1788201140.984430:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681161856 00000100:00100000:0.0:1788201140.984450:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201140.984456:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681161856:12345-0@lo:503: 00000100:00100000:0.0:1788201140.984536:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681161856:12345-0@lo:503: Request processed in 79us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201140.984543:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201140.984586:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681161856:0@lo:503: 00000100:00100000:1.0:1788201140.987518:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681160960:12345-0@lo:400: Request processed in 1087us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.987547:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:0.0:1788201140.990605:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788201140.991186:0:8478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8478:1875064681161984:0@lo:502: 00000100:00100000:0.0:1788201140.991291:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201140.991500:0:8478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854c4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.991857:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681161984 00000100:00100000:1.0:1788201140.991867:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681161984 40000000:02000000:0.0:1788201140.991919:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788201140.991935:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201140.991946:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8478:x1875064681161984:12345-0@lo:502: 00000100:00100000:1.0:1788201140.992102:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8478:x1875064681161984:12345-0@lo:502: Request processed in 157us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.992121:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201140.993170:0:8478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8478:1875064681161984:0@lo:502: 00000100:00100000:1.0:1788201140.993251:0:8478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8478:1875064681162112:0@lo:502: 00000100:00100000:1.0:1788201140.993302:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.993337:0:8478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba266240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201140.993370:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681162112 00000100:00100000:3.0:1788201140.993376:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681162112 00000100:00100000:3.0:1788201140.993439:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201140.993449:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8478:x1875064681162112:12345-0@lo:502: 00000100:00100000:3.0:1788201140.993585:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:8478:x1875064681162112:12345-0@lo:502: Request processed in 136us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.993592:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201140.993609:0:8478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8478:1875064681162112:0@lo:502: 00000040:00080000:1.0:1788201140.993629:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788201140.993963:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788201140.993992:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201140.994005:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.994019:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201140.994030:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201140.994033:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0889be000 from 5 10000000:01000000:2.0:1788201140.994036:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201140.994067:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.994077:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.994087:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.994101:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162240:0@lo:101: 00000100:00100000:2.0:1788201140.994146:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.994169:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.995863:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681162240 00000100:00100000:1.0:1788201140.995876:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681162240 00000100:00100000:1.0:1788201140.995945:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788201140.995956:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681162240:12345-0@lo:101: 00010000:00010000:1.0:1788201140.995975:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201140.996007:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472009a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.996039:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472009a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.996052:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472009a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.996064:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081670200, rc 0) 00000100:00100000:1.0:1788201140.996154:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681162240:12345-0@lo:101: Request processed in 200us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.996161:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201140.996231:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162240:0@lo:101: 00010000:00010000:2.0:1788201140.996254:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201140.996264:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201140.996337:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162368:0@lo:256: 00000100:00100000:2.0:1788201140.996377:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201140.996414:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201140.996459:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681162368 00000100:00100000:3.0:1788201140.996464:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681162368 00000100:00100000:3.0:1788201140.996532:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201140.996540:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681162368:12345-0@lo:256: 20000000:01000000:3.0:1788201140.996573:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201140.996594:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201140.996598:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788201140.996734:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681162368:12345-0@lo:256: Request processed in 185us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201140.996773:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201140.996817:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162368:0@lo:256: 10000000:01000000:1.0:1788201140.996865:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201140.996872:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.996883:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201140.996892:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788201140.996894:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788201140.996898:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201140.996918:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.996926:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.996946:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201140.996960:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162496:0@lo:101: 00000100:00100000:1.0:1788201140.996988:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.997008:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba266240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.997022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681162496 00000100:00100000:1.0:1788201140.997026:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681162496 00000100:00100000:1.0:1788201140.997057:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201140.997064:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681162496:12345-0@lo:101: 00010000:00010000:1.0:1788201140.997072:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201140.997081:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447200a8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.997098:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.997106:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.997123:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081670a00, rc 0) 00000100:00100000:1.0:1788201140.997150:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681162496:12345-0@lo:101: Request processed in 87us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.997155:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201140.997182:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162496:0@lo:101: 00010000:00010000:1.0:1788201140.997195:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201140.997213:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201140.997285:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162624:0@lo:501: 00000100:00100000:1.0:1788201140.997310:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.997322:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aafe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.997333:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681162624 00000100:00100000:1.0:1788201140.997336:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681162624 00000100:00100000:1.0:1788201140.997355:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201140.997361:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681162624:12345-0@lo:501: 00000100:00100000:1.0:1788201140.997489:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681162624:12345-0@lo:501: Request processed in 128us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.997496:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201140.997522:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162624:0@lo:501: 00000100:00100000:1.0:1788201140.997549:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162752:0@lo:503: 00000100:00100000:1.0:1788201140.997588:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201140.997600:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aafe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201140.997610:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681162752 00000100:00100000:1.0:1788201140.997614:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681162752 00000100:00100000:1.0:1788201140.997630:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201140.997636:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681162752:12345-0@lo:503: 00000100:00100000:1.0:1788201140.997819:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681162752:12345-0@lo:503: Request processed in 182us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201140.997826:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201140.997866:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681162752:0@lo:503: 00000100:00100000:0.0:1788201141.002133:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1875064681161600:12345-0@lo:700: Request processed in 19389us (19519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201141.002150:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788201141.004351:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce09e1c6d80 x1875064681161600/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788201156 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201141.004373:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1875064681161600:0@lo:700: 40000000:02000000:1.0:1788201141.004391:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1788201141.007836:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8480:1875064681162880:0@lo:502: 00000100:00100000:3.0:1788201141.008226:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201141.008295:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201141.008321:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681162880 00000100:00100000:0.0:1788201141.008337:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681162880 00000100:00100000:0.0:1788201141.008406:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788201141.008430:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:8480:x1875064681162880:12345-0@lo:502: 00000100:00100000:0.0:1788201141.008597:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:8480:x1875064681162880:12345-0@lo:502: Request processed in 169us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201141.008605:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788201141.008679:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8480:1875064681162880:0@lo:502: 00000020:01000000:3.0:1788201141.008719:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201141.008729:0:8480:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788201141.009298:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201141.009303:0:8480:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788201141.009316:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201141.009321:0:8480:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:3.0:1788201141.009352:0:8480:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201141.009355:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201141.009390:0:8480:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ce0bf454d40) 00000020:00000080:3.0:1788201141.009421:0:8480:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788201141.009434:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201141.010273:0:8480:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788201141.010282:0:8480:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788201141.010292:0:8480:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee447200bd 00010000:00080000:3.0:1788201141.010338:0:8480:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0bf45e800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1788201141.011800:0:8480:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:3.0:1788201141.021533:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788201141.022917:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8475:x1875064681161472:12345-0@lo:700: Request processed in 40360us (40561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201141.022942:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788201141.024330:0:8475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce09e1c4000 x1875064681161472/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788201156 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201141.024353:0:8475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8475:1875064681161472:0@lo:700: 00000040:01000000:1.0:1788201141.024944:0:8480:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788201141.024970:0:8480:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201141.027636:0:8480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201141.027960:0:8480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201141.028171:0:8480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788201141.028282:0:8480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788201141.035601:0:8482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201141.035612:0:8482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788201141.037308:0:8480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201141.037326:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201141.037376:0:8480:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788201141.037405:0:8480:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee447200c4 00000100:00080000:0.0:1788201141.037418:0:8480:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201141.037425:0:8480:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce0bf45e800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201141.037471:0:8480:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8198f800 x1875064681163008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201141.037499:0:8480:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788201141.037573:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201141.037577:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201141.037580:0:8480:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788201141.037583:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201141.037588:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201141.037589:0:8480:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201141.037592:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201141.037595:0:8480:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788201141.037627:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8480:1875064681163136:0@lo:502: 00000100:00100000:0.0:1788201141.037731:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.037809:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201141.037837:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681163136 00000100:00100000:0.0:1788201141.037843:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681163136 00000100:00100000:0.0:1788201141.038351:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201141.038363:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:8480:x1875064681163136:12345-0@lo:502: 00000100:00100000:1.0:1788201141.038403:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681163008:0@lo:8: 00000100:00100000:1.0:1788201141.038470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.038517:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:8480:x1875064681163136:12345-0@lo:502: Request processed in 154us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201141.038531:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201141.038581:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681163008 00000100:00100000:0.0:1788201141.038585:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681163008 00000100:00100000:0.0:1788201141.038612:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201141.038617:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875064681163008:12345-0@lo:8: 00010000:00080000:0.0:1788201141.038643:0:8432:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1788201141.038671:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee447200cb 00002000:00100000:0.0:1788201141.038687:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cdf81975000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788201141.038692:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788201141.038696:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201141.038817:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201141.039434:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9cdf81970800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201141.039502:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681163008:12345-0@lo:8: Request processed in 882us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201141.039511:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788201141.039563:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f800 x1875064681163008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201141.039574:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201141.039583:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788201141.039591:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788201141.039597:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788201141.039599:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788201141.039652:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788201141.039657:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681163008:0@lo:8: 00000100:00100000:0.0:1788201141.039695:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:8480:1875064681163136:0@lo:502: 00000020:01000000:0.0:1788201141.039758:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201141.039766:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201141.039769:0:8480:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788201141.039777:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:1.0:1788201141.040149:0:8482:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201141.040222:0:8482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 221337482553ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201141.040230:0:8482:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:0.0:1788201141.042371:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788201141.042413:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201141.042426:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201141.042441:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201141.042454:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788201141.042457:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ce0b2520000 from 1 10000000:01000000:0.0:1788201141.042460:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788201141.042502:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201141.042512:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201141.042525:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201141.042551:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681163264:0@lo:101: 00000100:00100000:0.0:1788201141.042631:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.042685:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201141.043560:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681163264 00000100:00100000:1.0:1788201141.043572:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681163264 00000100:00100000:1.0:1788201141.043627:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788201141.043638:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681163264:12345-0@lo:101: 00010000:00010000:1.0:1788201141.043656:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201141.043671:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447200d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201141.043714:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201141.043727:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201141.043761:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081671000, rc 0) 00000100:00100000:1.0:1788201141.043843:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681163264:12345-0@lo:101: Request processed in 193us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201141.043851:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201141.044399:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681163264:0@lo:101: 00010000:00010000:0.0:1788201141.044422:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201141.044445:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201141.044529:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681163392:0@lo:501: 00000100:00100000:0.0:1788201141.044567:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.044593:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201141.044613:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681163392 00000100:00100000:0.0:1788201141.044617:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681163392 00000100:00100000:0.0:1788201141.044650:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788201141.044658:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681163392:12345-0@lo:501: 00000100:00100000:0.0:1788201141.044756:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681163392:12345-0@lo:501: Request processed in 98us (188us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201141.044762:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788201141.044796:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681163392:0@lo:501: 10000000:01000000:0.0:1788201141.044822:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788201141.044828:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201141.048305:0:8475:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788201141.048348:0:8475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8475:1875064681163648:0@lo:7: 00000100:00100000:1.0:1788201141.048437:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201141.048482:0:8475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aafd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201141.048506:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681163648 00000100:00100000:2.0:1788201141.048516:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681163648 00000100:00100000:2.0:1788201141.048582:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201141.048905:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8475:x1875064681163648:12345-0@lo:7: 00010000:00010000:0.0:1788201141.051484:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201141.051524:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681163520:0@lo:13: 00000100:00100000:0.0:1788201141.051621:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201141.051964:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681163520 00000100:00100000:3.0:1788201141.051975:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681163520 00000100:00100000:3.0:1788201141.052041:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201141.052053:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681163520:12345-0@lo:13: 00002000:00000024:3.0:1788201141.052085:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1788201141.052158:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681163520:12345-0@lo:13: Request processed in 108us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201141.052166:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201141.052358:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0834cb480 x1875064681163520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201141.052382:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681163520:0@lo:13: 00000004:00080000:1.0:1788201141.052610:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788201141.060464:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788201141.060476:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788201141.060621:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8475:x1875064681163648:12345-0@lo:7: Request processed in 11714us (12177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201141.060634:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788201141.061141:0:8475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0834c9500 x1875064681163648/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201157 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201141.061163:0:8475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8475:1875064681163648:0@lo:7: 00000004:00080000:0.0:1788201141.061192:0:8475:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788201141.061252:0:8475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8475:1875064681163776:0@lo:5: 00000100:00100000:0.0:1788201141.061305:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.061353:0:8475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201141.062256:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681163776 00000100:00100000:2.0:1788201141.062267:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681163776 00000100:00100000:2.0:1788201141.062320:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201141.062330:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8475:x1875064681163776:12345-0@lo:5: 00002000:00080000:2.0:1788201141.062367:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788201141.062431:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8475:x1875064681163776:12345-0@lo:5: Request processed in 102us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201141.062438:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788201141.062490:0:8475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f800 x1875064681163776/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201157 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201141.062506:0:8475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8475:1875064681163776:0@lo:5: 00000100:00100000:0.0:1788201141.062506:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681163904:0@lo:13: 00000004:00080000:2.0:1788201141.062531:0:8475:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788201141.062546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201141.062566:0:8475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8475:1875064681164032:0@lo:5: 00000004:00080000:0.0:1788201141.062585:0:8483:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788201141.062605:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8483:1875064681164160:0@lo:7: 00000100:00100000:0.0:1788201141.062628:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.062642:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201141.063090:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201141.063126:0:8475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201141.063149:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681164160 00000100:00100000:2.0:1788201141.063155:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681164160 00000100:00100000:2.0:1788201141.063234:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681164032 00000100:00100000:2.0:1788201141.063238:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681164032 00000100:00100000:2.0:1788201141.063263:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201141.063271:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8483:x1875064681164160:12345-0@lo:7: 00000100:00100000:3.0:1788201141.063292:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681163904 00000100:00100000:3.0:1788201141.063298:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681163904 00000100:00100000:3.0:1788201141.063331:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201141.063341:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681163904:12345-0@lo:13: 00002000:00000024:3.0:1788201141.063358:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1788201141.063405:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681163904:12345-0@lo:13: Request processed in 66us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201141.063412:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201141.063456:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f480 x1875064681163904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201141.063476:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681163904:0@lo:13: 00000100:00080000:0.0:1788201141.064183:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788201141.072469:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788201141.072481:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788201141.073040:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8483:x1875064681164160:12345-0@lo:7: Request processed in 9761us (10401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201141.073055:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201141.073100:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201141.073125:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8475:x1875064681164032:12345-0@lo:5: 00002000:00080000:2.0:1788201141.073177:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:0.0:1788201141.073276:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f100 x1875064681164160/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201157 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201141.073296:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8483:1875064681164160:0@lo:7: 00000004:00080000:0.0:1788201141.073315:0:8483:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788201141.073364:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8483:1875064681164288:0@lo:5: 00000100:00100000:0.0:1788201141.073415:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.073454:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201141.073537:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788201141.073548:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788201141.078880:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8475:x1875064681164032:12345-0@lo:5: Request processed in 5760us (15779us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788201141.078898:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201141.079668:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681164288 00000100:00100000:2.0:1788201141.079684:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681164288 00000100:00100000:2.0:1788201141.079845:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201141.079857:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8483:x1875064681164288:12345-0@lo:5: 00002000:00080000:2.0:1788201141.079900:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788201141.079906:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:0.0:1788201141.082533:0:8475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce09e1c4000 x1875064681164032/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201157 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201141.082557:0:8475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8475:1875064681164032:0@lo:5: 00000004:00080000:0.0:1788201141.082574:0:8475:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788201141.082624:0:8475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8475:1875064681164416:0@lo:900: 00000100:00100000:0.0:1788201141.082698:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.082805:0:8475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201141.087784:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681164416 00000100:00100000:2.0:1788201141.087807:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681164416 00000100:00100000:2.0:1788201141.087880:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201141.087892:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8475:x1875064681164416:12345-0@lo:900: 00000100:00100000:2.0:1788201141.089842:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8475:x1875064681164416:12345-0@lo:900: Request processed in 1939us (7131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201141.089858:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788201141.089935:0:8475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198df80 x1875064681164416/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201157 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201141.089955:0:8475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8475:1875064681164416:0@lo:900: 00000001:00080000:0.0:1788201141.096040:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1788201141.096058:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788201141.096070:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788201141.096282:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8483:x1875064681164288:12345-0@lo:5: Request processed in 16421us (22860us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788201141.096295:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788201141.096411:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f100 x1875064681164288/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201157 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201141.096424:0:8483:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788201141.096432:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8483:1875064681164288:0@lo:5: 00000004:00080000:0.0:1788201141.096450:0:8483:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788201141.096508:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8483:1875064681164544:0@lo:700: 00000100:00100000:0.0:1788201141.096549:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.096638:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201141.104035:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681164544 00000100:00100000:2.0:1788201141.104056:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681164544 00000100:00100000:2.0:1788201141.104150:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201141.104163:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8483:x1875064681164544:12345-0@lo:700: 00000100:00100000:2.0:1788201141.124942:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8483:x1875064681164544:12345-0@lo:700: Request processed in 20768us (28378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201141.124959:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788201141.124966:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f100 x1875064681164544/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788201157 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201141.124984:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8483:1875064681164544:0@lo:700: 00000004:02000040:0.0:1788201141.129069:0:8483:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788201141.140284:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8483:1875064681164672:0@lo:5: 00000100:00100000:0.0:1788201141.140368:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201141.140426:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201141.141136:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681164672 00000100:00100000:1.0:1788201141.141148:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681164672 00000100:00100000:1.0:1788201141.141215:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201141.141226:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8483:x1875064681164672:12345-0@lo:5: 00002000:00080000:1.0:1788201141.155187:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788201141.155213:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788201141.160710:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8483:x1875064681164672:12345-0@lo:5: Request processed in 19476us (20331us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788201141.160735:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788201141.167051:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f100 x1875064681164672/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201157 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201141.167077:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8483:1875064681164672:0@lo:5: 00000004:00080000:0.0:1788201141.167100:0:8483:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1788201141.431354:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201142.047446:0:8518:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201142.047695:0:8518:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201142.453886:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.478286:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201144.508439:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201145.525911:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201145.975223:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681164800:0@lo:41: 00000100:00100000:1.0:1788201145.975273:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681164928:0@lo:41: 00000100:00100000:0.0:1788201145.975328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201145.975363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201145.975402:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681164800 00000100:00100000:0.0:1788201145.975410:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681164800 00000100:00100000:0.0:1788201145.975456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681164928 00000100:00100000:0.0:1788201145.975459:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681164928 00000100:00100000:2.0:1788201145.975902:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201145.975914:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681164800:12345-0@lo:41: 00000004:00000024:2.0:1788201145.975959:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788201145.976027:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681164800:12345-0@lo:41: Request processed in 115us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201145.976034:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201145.976053:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201145.976059:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681164928:12345-0@lo:41: 00000004:00000024:2.0:1788201145.976090:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788201145.976120:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681164928:12345-0@lo:41: Request processed in 62us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201145.976126:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201145.976176:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681164928:0@lo:41: 00000100:00100000:0.0:1788201145.978119:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681164800:0@lo:41: 00000100:00100000:2.0:1788201146.487063:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681165056:0@lo:400: 00000100:00100000:2.0:1788201146.487184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201146.487252:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681165568:0@lo:400: 00000100:00100000:2.0:1788201146.487289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201146.487322:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201146.487328:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681165184:0@lo:400: 00000100:00100000:2.0:1788201146.487353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201146.487373:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681165696:0@lo:400: 00000100:00100000:2.0:1788201146.487399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201146.487432:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681165312:0@lo:400: 00000100:00100000:2.0:1788201146.487457:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201146.487478:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681165824:0@lo:400: 00000100:00100000:2.0:1788201146.487518:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201146.487539:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201146.487545:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681165440:0@lo:400: 00000100:00100000:2.0:1788201146.487578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201146.487619:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681165568 00000100:00100000:2.0:1788201146.487629:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681165568 00000100:00100000:2.0:1788201146.487695:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681165184 00000100:00100000:2.0:1788201146.487699:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681165184 00000100:00100000:2.0:1788201146.487713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681165312 00000100:00100000:2.0:1788201146.487716:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681165312 00000100:00100000:2.0:1788201146.487726:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681165440 00000100:00100000:2.0:1788201146.487728:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681165440 00000100:00100000:2.0:1788201146.487775:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201146.487786:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681165568:12345-0@lo:400: 00000100:00100000:2.0:1788201146.487854:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681165568:12345-0@lo:400: Request processed in 69us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201146.487862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201146.487881:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201146.487887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681165184:12345-0@lo:400: 00000100:00100000:2.0:1788201146.487916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681165184:12345-0@lo:400: Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201146.487922:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201146.487933:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201146.487938:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681165312:12345-0@lo:400: 00000100:00100000:2.0:1788201146.487968:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681165312:12345-0@lo:400: Request processed in 30us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201146.487974:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201146.487986:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201146.487992:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681165440:12345-0@lo:400: 00000100:00100000:2.0:1788201146.488019:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681165440:12345-0@lo:400: Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201146.488031:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201146.488058:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681165696 00000100:00100000:2.0:1788201146.488062:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681165696 00000100:00100000:2.0:1788201146.488101:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681165824 00000100:00100000:2.0:1788201146.488105:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681165824 00000100:00100000:2.0:1788201146.488123:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201146.488129:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681165696:12345-0@lo:400: 00000100:00100000:2.0:1788201146.488161:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681165696:12345-0@lo:400: Request processed in 32us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201146.488167:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201146.488178:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201146.488183:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681165824:12345-0@lo:400: 00000100:00100000:2.0:1788201146.488219:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681165824:12345-0@lo:400: Request processed in 35us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201146.488226:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788201146.488258:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201146.488264:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201146.488266:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788201146.488300:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce09e1c5180 x1875064681165440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201146.488319:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681165440:0@lo:400: 00010000:00080000:2.0:1788201146.488334:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce09e1c7b80 x1875064681165312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201146.488343:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681165312:0@lo:400: 00010000:00080000:2.0:1788201146.488354:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82394e00 x1875064681165824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201146.488376:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681165824:0@lo:400: 00010000:00080000:2.0:1788201146.488417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce09e1c4a80 x1875064681165184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201146.488426:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681165184:0@lo:400: 00010000:00080000:2.0:1788201146.488437:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82397b80 x1875064681165696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201146.488445:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788201146.488456:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681165696:0@lo:400: 00010000:00080000:2.0:1788201146.488466:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82396a00 x1875064681165568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201146.488474:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681165568:0@lo:400: 00000100:00100000:0.0:1788201146.492255:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681165056 00000100:00100000:0.0:1788201146.492273:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681165056 00000100:00100000:0.0:1788201146.492365:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788201146.492378:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3646:x1875064681165056:12345-0@lo:400: 00000100:00100000:0.0:1788201146.495644:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3646:x1875064681165056:12345-0@lo:400: Request processed in 3254us (8445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201146.495662:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788201146.496622:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681165952:0@lo:13: 00000100:00100000:3.0:1788201146.496718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201146.496810:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681165952 00000100:00100000:3.0:1788201146.496819:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681165952 00000100:00100000:3.0:1788201146.496873:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201146.496884:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681165952:12345-0@lo:13: 00002000:00000024:3.0:1788201146.496926:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201146.496986:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681165952:12345-0@lo:13: Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201146.497004:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788201146.497562:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0834cb480 x1875064681165952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201146.497589:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681165952:0@lo:13: 00000100:00100000:3.0:1788201146.497657:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681166080:0@lo:13: 00000100:00100000:3.0:1788201146.497700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201146.497767:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681165056:0@lo:400: 00000100:00100000:3.0:1788201146.497793:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681166080 00000100:00100000:3.0:1788201146.497798:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681166080 00000100:00100000:3.0:1788201146.497827:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201146.497835:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681166080:12345-0@lo:13: 00002000:00000024:3.0:1788201146.497851:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201146.497885:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681166080:12345-0@lo:13: Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201146.497892:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788201146.497920:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0ba3b1880 x1875064681166080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201146.499653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681166080:0@lo:13: 00000001:00080000:0.0:1788201146.503623:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1788201146.551428:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201147.578180:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201148.600613:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201149.228999:0:8808:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788201149.626266:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788201150.469307:0:8860:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201150.469563:0:8860:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201150.646489:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201151.094427:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201151.094452:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681166208:0@lo:41: 00000100:00100000:0.0:1788201151.094536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.094720:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201151.094731:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681166336:0@lo:41: 00000100:00100000:3.0:1788201151.094781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.094812:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681166208 00000100:00100000:3.0:1788201151.094818:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681166208 00000100:00100000:3.0:1788201151.094865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681166336 00000100:00100000:3.0:1788201151.094869:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681166336 00000100:00100000:3.0:1788201151.094885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201151.094894:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681166208:12345-0@lo:41: 00000004:00000024:3.0:1788201151.094928:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788201151.094970:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681166208:12345-0@lo:41: Request processed in 77us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201151.094978:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201151.094995:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201151.095002:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681166336:12345-0@lo:41: 00000004:00000024:3.0:1788201151.095019:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788201151.095067:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681166336:12345-0@lo:41: Request processed in 65us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201151.095072:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201151.095108:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681166336:0@lo:41: 00000100:00100000:0.0:1788201151.095398:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681166208:0@lo:41: 00000100:00100000:3.0:1788201151.609045:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681166464:0@lo:400: 00000100:00100000:3.0:1788201151.609118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.609164:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681166976:0@lo:400: 00000100:00100000:3.0:1788201151.609220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.609246:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201151.609252:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681166848:0@lo:400: 00000100:00100000:3.0:1788201151.609275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.609303:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681166592:0@lo:400: 00000100:00100000:3.0:1788201151.609325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.609340:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681167104:0@lo:400: 00000100:00100000:3.0:1788201151.609363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.609380:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201151.609386:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681166720:0@lo:400: 00000100:00100000:3.0:1788201151.609406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.609420:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681167232:0@lo:400: 00000100:00100000:3.0:1788201151.609439:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201151.609466:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681166464 00000100:00100000:3.0:1788201151.609472:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681166464 00000100:00100000:3.0:1788201151.609516:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201151.609524:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3645:x1875064681166464:12345-0@lo:400: 00000100:00100000:3.0:1788201151.609574:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3645:x1875064681166464:12345-0@lo:400: Request processed in 50us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201151.609581:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201151.609632:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681166464:0@lo:400: 00000100:00100000:1.0:1788201151.609821:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681167360:0@lo:13: 00000100:00100000:1.0:1788201151.609852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201151.609886:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681167360 00000100:00100000:1.0:1788201151.609890:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681167360 00000100:00100000:1.0:1788201151.609933:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201151.609941:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681167360:12345-0@lo:13: 00002000:00000024:1.0:1788201151.609964:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201151.609999:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681167360:12345-0@lo:13: Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201151.610005:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788201151.610020:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201151.610051:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0834c9500 x1875064681167360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201151.610128:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788201151.610143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681166976 00000100:00100000:2.0:1788201151.610147:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681166976 00000100:00100000:1.0:1788201151.610148:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681167360:0@lo:13: 00000100:00100000:1.0:1788201151.610158:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201151.610163:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681167488:0@lo:13: 00000100:00100000:1.0:1788201151.610186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201151.610215:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681166848 00000100:00100000:2.0:1788201151.610218:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681166848 00000100:00100000:3.0:1788201151.610250:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681167488 00000100:00100000:3.0:1788201151.610254:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681167488 00000100:00080000:0.0:1788201151.610296:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201151.610299:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201151.610301:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201151.610364:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681166592 00000100:00100000:2.0:1788201151.610368:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681166592 00000100:00100000:2.0:1788201151.610379:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681166720 00000100:00100000:2.0:1788201151.610381:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681166720 00000100:00100000:2.0:1788201151.610394:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201151.610402:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681166976:12345-0@lo:400: 00000100:00100000:2.0:1788201151.610445:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681166976:12345-0@lo:400: Request processed in 44us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201151.610451:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201151.610464:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201151.610477:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681166848:12345-0@lo:400: 00000100:00100000:2.0:1788201151.610508:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681166848:12345-0@lo:400: Request processed in 32us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201151.610515:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201151.610527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201151.610532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681166592:12345-0@lo:400: 00000100:00100000:2.0:1788201151.610564:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681166592:12345-0@lo:400: Request processed in 32us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201151.610571:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201151.610581:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201151.610587:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681166720:12345-0@lo:400: 00000100:00100000:2.0:1788201151.610613:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681166720:12345-0@lo:400: Request processed in 27us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201151.610619:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201151.610645:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681167104 00000100:00100000:2.0:1788201151.610649:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681167104 00000100:00100000:2.0:1788201151.610670:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681167232 00000100:00100000:2.0:1788201151.610673:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681167232 00000100:00100000:2.0:1788201151.610691:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201151.610697:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681167104:12345-0@lo:400: 00000100:00100000:2.0:1788201151.610726:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681167104:12345-0@lo:400: Request processed in 29us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201151.610731:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201151.610787:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201151.610793:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681167232:12345-0@lo:400: 00000100:00100000:2.0:1788201151.610819:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681167232:12345-0@lo:400: Request processed in 27us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201151.610919:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788201151.610962:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0ba3b0380 x1875064681166720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201151.610975:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681166720:0@lo:400: 00010000:00080000:2.0:1788201151.610989:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b94c4380 x1875064681167232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201151.610997:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681167232:0@lo:400: 00010000:00080000:2.0:1788201151.611006:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0ba3b0000 x1875064681166592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201151.611014:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681166592:0@lo:400: 00010000:00080000:2.0:1788201151.611023:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b94c4a80 x1875064681167104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201151.611030:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681167104:0@lo:400: 00010000:00080000:2.0:1788201151.611074:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b94c6680 x1875064681166848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201151.611081:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681166848:0@lo:400: 00010000:00080000:2.0:1788201151.611091:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b94c5880 x1875064681166976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201151.611098:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681166976:0@lo:400: 00000100:00100000:3.0:1788201151.611345:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201151.611352:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681167488:12345-0@lo:13: 00002000:00000024:3.0:1788201151.611366:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201151.611410:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681167488:12345-0@lo:13: Request processed in 59us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201151.611416:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788201151.611442:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82396a00 x1875064681167488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201151.611454:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681167488:0@lo:13: 00010000:00010000:2.0:1788201151.670095:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201152.694016:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201153.718058:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201153.843122:0:8962:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201153.843725:0:8962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201154.742363:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201155.101566:0:9010:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201155.101578:0:9010:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788201155.766473:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201156.217234:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681167616:0@lo:41: 00000100:00100000:2.0:1788201156.217331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.217429:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681167616 00000100:00100000:2.0:1788201156.217439:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681167616 00000100:00100000:2.0:1788201156.217495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201156.217506:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681167616:12345-0@lo:41: 00000004:00000024:2.0:1788201156.217573:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788201156.217628:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681167616:12345-0@lo:41: Request processed in 122us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.217635:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201156.217692:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681167616:0@lo:41: 00000100:00100000:2.0:1788201156.227329:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681167744:0@lo:41: 00000100:00100000:2.0:1788201156.227424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.227542:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681167744 00000100:00100000:1.0:1788201156.227552:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681167744 00000100:00100000:1.0:1788201156.227623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201156.227635:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681167744:12345-0@lo:41: 00000004:00000024:1.0:1788201156.227679:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788201156.227769:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681167744:12345-0@lo:41: Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201156.227778:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201156.227830:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681167744:0@lo:41: 00000100:00100000:3.0:1788201156.727273:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681167872:0@lo:13: 00000100:00100000:3.0:1788201156.727370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.727462:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681167872 00000100:00100000:3.0:1788201156.727473:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681167872 00000100:00100000:3.0:1788201156.727619:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201156.727632:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681167872:12345-0@lo:13: 00002000:00000024:3.0:1788201156.727673:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201156.727727:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681167872:12345-0@lo:13: Request processed in 98us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.727767:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788201156.727792:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201156.727843:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f480 x1875064681167872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201156.728569:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681167872:0@lo:13: 00000100:00100000:0.0:1788201156.728886:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681168128:0@lo:400: 00000100:00100000:3.0:1788201156.729612:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681168384:0@lo:400: 00000100:00100000:3.0:1788201156.729674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.729715:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681168896:0@lo:400: 00000100:00100000:3.0:1788201156.729773:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.729814:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201156.729821:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681168000:0@lo:13: 00000100:00100000:3.0:1788201156.729858:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.729906:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681168512:0@lo:400: 00000100:00100000:0.0:1788201156.730040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.730069:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681168640:0@lo:400: 00000100:00100000:0.0:1788201156.730094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.730126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201156.730133:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681168256:0@lo:400: 00000100:00100000:0.0:1788201156.730172:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681168128 00000100:00100000:0.0:1788201156.730182:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681168128 00000100:00100000:0.0:1788201156.730236:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788201156.730246:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3646:x1875064681168128:12345-0@lo:400: 00000100:00100000:0.0:1788201156.730306:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3646:x1875064681168128:12345-0@lo:400: Request processed in 61us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.730314:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788201156.730352:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681168384 00000100:00100000:0.0:1788201156.730356:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681168384 00000100:00100000:0.0:1788201156.730375:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681168640 00000100:00100000:0.0:1788201156.730377:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681168640 00000100:00100000:0.0:1788201156.730390:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201156.730397:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681168384:12345-0@lo:400: 00000100:00100000:0.0:1788201156.730437:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681168384:12345-0@lo:400: Request processed in 41us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.730444:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201156.730455:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201156.730461:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681168640:12345-0@lo:400: 00000100:00100000:0.0:1788201156.730487:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681168640:12345-0@lo:400: Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.730492:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201156.731604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.731732:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681169024:0@lo:400: 00000100:00100000:3.0:1788201156.732014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.732065:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681168384:0@lo:400: 00000100:00100000:3.0:1788201156.732121:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681168896 00000100:00100000:3.0:1788201156.732128:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681168896 00000100:00100000:3.0:1788201156.732183:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681168512 00000100:00100000:3.0:1788201156.732187:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681168512 00000100:00100000:3.0:1788201156.732208:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201156.732217:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681168896:12345-0@lo:400: 00000100:00100000:3.0:1788201156.732270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681168896:12345-0@lo:400: Request processed in 55us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.732277:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201156.732292:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201156.732298:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681168512:12345-0@lo:400: 00000100:00100000:3.0:1788201156.732323:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681168512:12345-0@lo:400: Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.732328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201156.732354:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681169024 00000100:00100000:3.0:1788201156.732357:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681169024 00000100:00100000:3.0:1788201156.732383:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201156.732389:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681169024:12345-0@lo:400: 00000100:00100000:3.0:1788201156.732416:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681169024:12345-0@lo:400: Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.732435:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788201156.732463:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201156.732468:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201156.732479:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681168000 00000100:00100000:3.0:1788201156.732483:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681168000 00000100:00100000:1.0:1788201156.732701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.739259:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681168768:0@lo:400: 00000100:00100000:1.0:1788201156.739343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.739411:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681168128:0@lo:400: 00000100:00100000:1.0:1788201156.739431:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681168640:0@lo:400: 00000100:00100000:0.0:1788201156.740815:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681168256 00000100:00100000:0.0:1788201156.740828:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681168256 00000100:00100000:0.0:1788201156.740900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681168768 00000100:00100000:0.0:1788201156.740904:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681168768 00000100:00100000:0.0:1788201156.740947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201156.740967:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681168256:12345-0@lo:400: 00000100:00100000:0.0:1788201156.741075:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681168256:12345-0@lo:400: Request processed in 110us (8373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.741082:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201156.741101:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201156.741109:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681168768:12345-0@lo:400: 00000100:00100000:0.0:1788201156.741140:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681168768:12345-0@lo:400: Request processed in 33us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.741146:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788201156.741525:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198c380 x1875064681168256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201156.741542:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681168256:0@lo:400: 00010000:00080000:1.0:1788201156.741558:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b6c8b480 x1875064681168768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201156.741567:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681168768:0@lo:400: 00000100:00100000:3.0:1788201156.746636:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201156.746689:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681168000:12345-0@lo:13: 00002000:00000024:3.0:1788201156.747022:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201156.747124:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681168000:12345-0@lo:13: Request processed in 471us (17263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.747139:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788201156.747180:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201156.747233:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8198f480 x1875064681168000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201156.747264:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681168000:0@lo:13: 00010000:00080000:3.0:1788201156.747282:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b6c89c00 x1875064681168512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201156.747291:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681168512:0@lo:400: 00010000:00080000:3.0:1788201156.747302:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b6c8bb80 x1875064681169024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201156.747310:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681169024:0@lo:400: 00010000:00080000:3.0:1788201156.747321:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b6c8aa00 x1875064681168896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201156.747329:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681168896:0@lo:400: 00010000:00010000:1.0:1788201156.790404:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201157.819702:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201158.837957:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201159.865089:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201160.886069:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201161.333904:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201161.333932:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681169152:0@lo:41: 00000100:00100000:2.0:1788201161.334018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.334089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681169152 00000100:00100000:2.0:1788201161.334097:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681169152 00000100:00100000:2.0:1788201161.334161:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201161.334170:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681169152:12345-0@lo:41: 00000004:00000024:2.0:1788201161.334206:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788201161.334251:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681169152:12345-0@lo:41: Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.334258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201161.334305:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681169152:0@lo:41: 00000100:00100000:2.0:1788201161.334720:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681169280:0@lo:41: 00000100:00100000:2.0:1788201161.334779:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201161.334906:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681169280 00000100:00100000:0.0:1788201161.334912:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681169280 00000100:00100000:0.0:1788201161.334937:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201161.334944:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681169280:12345-0@lo:41: 00000004:00000024:0.0:1788201161.334981:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788201161.335024:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681169280:12345-0@lo:41: Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201161.335031:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201161.335115:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681169280:0@lo:41: 00000100:00100000:2.0:1788201161.846070:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681169408:0@lo:400: 00000100:00100000:2.0:1788201161.846163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846223:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681169920:0@lo:400: 00000100:00100000:2.0:1788201161.846253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846272:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681170432:0@lo:400: 00000100:00100000:2.0:1788201161.846298:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846325:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201161.846331:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681169536:0@lo:400: 00000100:00100000:2.0:1788201161.846356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846371:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681170048:0@lo:400: 00000100:00100000:2.0:1788201161.846391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846419:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681169664:0@lo:400: 00000100:00100000:2.0:1788201161.846440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846455:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681170176:0@lo:400: 00000100:00100000:2.0:1788201161.846475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846493:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201161.846498:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681169792:0@lo:400: 00000100:00100000:2.0:1788201161.846517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846533:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681170304:0@lo:400: 00000100:00100000:2.0:1788201161.846553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.846581:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681170432 00000100:00100000:2.0:1788201161.846595:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681170432 00000100:00100000:2.0:1788201161.846645:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681170304 00000100:00100000:2.0:1788201161.846648:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681170304 00000100:00100000:2.0:1788201161.846670:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201161.846679:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681170432:12345-0@lo:400: 00000100:00100000:2.0:1788201161.846733:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681170432:12345-0@lo:400: Request processed in 55us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.846771:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201161.846787:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201161.846794:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681170304:12345-0@lo:400: 00000100:00100000:2.0:1788201161.846825:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681170304:12345-0@lo:400: Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.846831:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201161.846850:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681169536 00000100:00100000:2.0:1788201161.846854:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681169536 00000100:00100000:2.0:1788201161.846872:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681170048 00000100:00100000:2.0:1788201161.846875:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681170048 00000100:00100000:2.0:1788201161.846888:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681170176 00000100:00100000:2.0:1788201161.846890:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681170176 00000100:00100000:2.0:1788201161.846901:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681169792 00000100:00100000:2.0:1788201161.846904:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681169792 00000100:00100000:2.0:1788201161.846916:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201161.846921:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681169536:12345-0@lo:400: 00000100:00100000:2.0:1788201161.846954:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681169536:12345-0@lo:400: Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.846960:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201161.846985:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201161.846992:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681170048:12345-0@lo:400: 00000100:00100000:2.0:1788201161.847023:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681170048:12345-0@lo:400: Request processed in 32us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.847037:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201161.847049:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201161.847056:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681170176:12345-0@lo:400: 00000100:00100000:2.0:1788201161.847087:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681170176:12345-0@lo:400: Request processed in 32us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.847093:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201161.847106:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201161.847112:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681169792:12345-0@lo:400: 00000100:00100000:2.0:1788201161.847141:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681169792:12345-0@lo:400: Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.847146:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201161.847166:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681169920 00000100:00100000:2.0:1788201161.847170:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681169920 00000100:00100000:2.0:1788201161.847187:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681169664 00000100:00100000:2.0:1788201161.847190:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681169664 00000100:00100000:2.0:1788201161.847203:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201161.847209:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681169920:12345-0@lo:400: 00000100:00100000:2.0:1788201161.847241:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681169920:12345-0@lo:400: Request processed in 33us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.847248:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201161.847261:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201161.847267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681169664:12345-0@lo:400: 00000100:00100000:2.0:1788201161.847295:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681169664:12345-0@lo:400: Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.847300:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788201161.847323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201161.847334:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201161.847337:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201161.847379:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82397800 x1875064681169792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201161.847393:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681169792:0@lo:400: 00010000:00080000:2.0:1788201161.847406:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82396a00 x1875064681170304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201161.847415:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681170304:0@lo:400: 00000100:00100000:2.0:1788201161.847425:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681169664:0@lo:400: 00010000:00080000:2.0:1788201161.847435:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82397480 x1875064681170176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201161.847443:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681170176:0@lo:400: 00010000:00080000:2.0:1788201161.847482:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82396300 x1875064681169536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201161.847491:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681169536:0@lo:400: 00010000:00080000:2.0:1788201161.847502:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82395500 x1875064681170048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201161.847510:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681170048:0@lo:400: 00000100:00100000:2.0:1788201161.847519:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681169920:0@lo:400: 00010000:00080000:2.0:1788201161.847528:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b94c5880 x1875064681170432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201161.847535:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681170432:0@lo:400: 00000100:00100000:3.0:1788201161.848506:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681169408 00000100:00100000:3.0:1788201161.848515:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681169408 00000100:00100000:3.0:1788201161.848601:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788201161.848610:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3644:x1875064681169408:12345-0@lo:400: 00000100:00100000:3.0:1788201161.848679:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3644:x1875064681169408:12345-0@lo:400: Request processed in 71us (2516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201161.848686:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788201161.849202:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681169408:0@lo:400: 00000100:00100000:2.0:1788201161.854043:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201161.854071:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681170560:0@lo:13: 00000100:00100000:2.0:1788201161.854157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.854212:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681170560 00000100:00100000:2.0:1788201161.854219:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681170560 00000100:00100000:2.0:1788201161.854265:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201161.854274:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681170560:12345-0@lo:13: 00002000:00000024:2.0:1788201161.854304:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201161.854346:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681170560:12345-0@lo:13: Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.854353:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788201161.854393:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b94c5880 x1875064681170560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201161.854411:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681170560:0@lo:13: 00000100:00100000:0.0:1788201161.857047:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201161.857072:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681170688:0@lo:13: 00000100:00100000:0.0:1788201161.857301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201161.867585:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681170688 00000100:00100000:2.0:1788201161.867601:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681170688 00000100:00100000:2.0:1788201161.867667:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201161.867676:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681170688:12345-0@lo:13: 00002000:00000024:2.0:1788201161.867703:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201161.868116:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681170688:12345-0@lo:13: Request processed in 439us (10814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.868124:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788201161.868231:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b6c88700 x1875064681170688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201161.868257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681170688:0@lo:13: 00010000:00010000:2.0:1788201161.918627:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201162.937175:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201163.959311:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201164.984931:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201165.627599:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201165.627603:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788201165.627605:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788201165.627771:0:9509:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9cdf81977800 00000020:01000004:0.0:1788201165.627791:0:9509:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788201165.627805:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788201165.627819:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ce0c1504d40) 00000020:00000080:0.0:1788201165.627836:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788201165.704060:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788201165.704124:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788201165.750328:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788201165.750599:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788201165.750615:0:9509:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201165.750630:0:9509:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf9b71aee447200e7 00000020:01000004:1.0:1788201165.750638:0:9509:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788201165.750665:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788201165.750669:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788201165.750676:0:9509:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788201165.750708:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788201165.750713:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788201165.782444:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201165.782491:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788201165.782496:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201165.782498:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201165.782499:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201165.782501:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201165.782502:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201165.782504:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201165.782506:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201165.782508:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201165.782509:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201165.782511:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201165.782513:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201165.782517:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788201165.782520:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201165.782521:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201165.782522:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201165.782523:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201165.782524:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201165.782525:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201165.782526:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201165.782527:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201165.782528:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201165.782529:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201165.782530:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201165.782579:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788201165.783427:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681170816:0@lo:253: 00000100:00100000:3.0:1788201165.783650:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201165.783815:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a0800480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201165.786391:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681170816 00000100:00100000:0.0:1788201165.786411:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681170816 00000100:00100000:1.0:1788201165.786728:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788201165.786770:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:9509:x1875064681170816:12345-0@lo:253: 20000000:01000000:1.0:1788201165.786830:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788201165.786836:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788201165.786842:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788201165.786846:0:6510:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788201165.787279:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201165.787437:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788201165.787454:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788201165.787470:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788201165.787475:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788201165.787486:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788201165.787512:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788201165.787636:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788201165.787653:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:1.0:1788201165.787655:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1788201165.787669:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788201165.787674:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788201165.787687:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788201165.787699:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1788201165.787713:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788201165.787720:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788201165.787731:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788201165.787782:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788201165.787855:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788201165.787865:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:1.0:1788201165.787867:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1788201165.787877:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788201165.787882:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788201165.787891:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788201165.787895:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1788201165.787905:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788201165.787909:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788201165.787918:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788201165.787931:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788201165.788305:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788201165.788319:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:1.0:1788201165.788320:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1788201165.788334:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788201165.788339:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788201165.788354:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788201165.788360:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1788201165.788389:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788201165.788397:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788201165.788410:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788201165.788426:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788201165.788439:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788201165.788442:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788201165.788447:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788201165.788498:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788201165.788506:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788201165.790032:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788201165.790408:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788201165.790438:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788201165.790453:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788201165.790464:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788201165.790482:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788201165.791394:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788201165.791443:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788201165.791455:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788201165.792391:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788201165.792422:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788201165.792437:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1788201165.792451:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788201165.792454:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788201165.793322:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1788201165.793358:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1788201165.793376:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788201165.793612:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788201165.793635:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788201165.793647:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788201165.793660:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788201165.793662:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788201165.794391:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788201165.794422:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788201165.794437:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788201165.794782:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788201165.794819:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788201165.794837:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788201165.794853:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788201165.794855:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788201165.795358:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788201165.795380:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788201165.795395:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788201165.795562:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788201165.795584:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788201165.795677:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1788201165.795699:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788201165.795725:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.795784:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.795793:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720007 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.795800:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720046 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796009:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720062 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796017:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472008c expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796032:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796039:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796047:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796170:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796188:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 21 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.796204:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681170944:0@lo:104: 00000100:00100000:3.0:1788201165.796287:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201165.796400:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796409:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 21 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.796418:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681171072:0@lo:104: 00000100:00100000:3.0:1788201165.796440:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201165.796897:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472008c expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.796910:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472008c expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.796928:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823af480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681171200:0@lo:104: 00000100:00100000:3.0:1788201165.796995:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.797099:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681170944 00000100:00100000:0.0:1788201165.797109:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681170944 00000100:00100000:1.0:1788201165.797226:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681171072 00000100:00100000:1.0:1788201165.797230:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681171072 00000100:00100000:1.0:1788201165.797250:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201165.797260:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6510:x1875064681170944:12345-0@lo:104: 00010000:00010000:1.0:1788201165.797275:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797342:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201165.797349:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6510:x1875064681170944:12345-0@lo:104: Request processed in 91us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.797358:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201165.797380:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201165.797386:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6510:x1875064681171072:12345-0@lo:104: 00010000:00010000:1.0:1788201165.797394:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797426:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201165.797431:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6510:x1875064681171072:12345-0@lo:104: Request processed in 46us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.797437:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788201165.797458:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201165.797465:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797483:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201165.797487:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797496:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201165.797503:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201165.797509:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201165.797552:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797559:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201165.797582:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797589:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74800/0xf9b71aee447200d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797614:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201165.797618:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797623:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081671c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201165.797626:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797641:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201165.797647:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201165.797652:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201165.797665:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797671:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201165.797687:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797693:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee447200a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.797701:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201165.797703:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201165.797705:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201165.797720:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681171328:0@lo:103: 00000100:00100000:1.0:1788201165.797775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.797828:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201165.797837:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681171456:0@lo:103: 00000100:00100000:1.0:1788201165.797863:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.797890:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681171328 00000100:00100000:1.0:1788201165.797894:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681171328 00010000:00010000:1.0:1788201165.797912:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 22 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201165.797956:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681171456 00000100:00100000:1.0:1788201165.797959:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681171456 00010000:00010000:1.0:1788201165.797974:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 23 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201165.797993:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201165.797999:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:3647:x1875064681171328:12345-0@lo:103: 00010000:00010000:1.0:1788201165.798012:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201165.798019:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 23 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.798030:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 23 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.798051:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201165.798080:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:3647:x1875064681171328:12345-0@lo:103: Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.798087:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201165.798099:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201165.798105:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3645:x1875064681171456:12345-0@lo:103: 00010000:00010000:1.0:1788201165.798113:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201165.798118:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 22 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.798126:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 22 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.798135:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201165.798165:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3645:x1875064681171456:12345-0@lo:103: Request processed in 60us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.798173:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201165.798217:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681171456:0@lo:103: 00000100:00100000:1.0:1788201165.798243:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681171328:0@lo:103: 00010000:00010000:0.0:1788201165.798454:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201165.799034:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720062 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.799049:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720062 expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.799061:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681171584:0@lo:104: 00000100:00100000:3.0:1788201165.799110:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201165.799318:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720046 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.799327:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720046 expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.799336:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82606d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681171712:0@lo:104: 00000100:00100000:3.0:1788201165.799359:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.799393:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681171200 00000100:00100000:2.0:1788201165.799401:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681171200 00000100:00100000:2.0:1788201165.799440:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681171584 00000100:00100000:2.0:1788201165.799443:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681171584 00000100:00100000:2.0:1788201165.799455:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201165.799462:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6510:x1875064681171200:12345-0@lo:104: 00010000:00010000:2.0:1788201165.799475:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.799532:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201165.799538:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6510:x1875064681171200:12345-0@lo:104: Request processed in 77us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.799544:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201165.799570:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201165.799585:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6510:x1875064681171584:12345-0@lo:104: 00010000:00010000:0.0:1788201165.799728:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201165.799761:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.799769:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081671800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201165.799774:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.799783:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201165.799792:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201165.799798:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201165.799843:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.799850:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201165.799864:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.799871:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee4472008c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.799893:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.799895:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.799897:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201165.800047:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.800104:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201165.800109:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6510:x1875064681171584:12345-0@lo:104: Request processed in 526us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.800116:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201165.800143:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201165.800157:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681171840:0@lo:103: 00000100:00100000:2.0:1788201165.800186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.800227:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681171840 00000100:00100000:2.0:1788201165.800232:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681171840 00010000:00010000:2.0:1788201165.800249:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472008c expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201165.800273:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201165.800279:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3644:x1875064681171840:12345-0@lo:103: 00010000:00010000:2.0:1788201165.800289:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201165.800294:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472008c expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.800306:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472008c expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.800327:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201165.800357:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3644:x1875064681171840:12345-0@lo:103: Request processed in 78us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.800363:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201165.800406:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681171840:0@lo:103: 00010000:00010000:0.0:1788201165.800527:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201165.800534:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.800550:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201165.800553:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.800560:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201165.800567:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201165.800573:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201165.800610:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.800616:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201165.800630:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.800637:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44720062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720069 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.800649:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.800656:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.800657:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201165.800923:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681171968:0@lo:103: 00000100:00100000:2.0:1788201165.800973:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.801066:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681171968 00000100:00100000:0.0:1788201165.801071:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681171968 00010000:00010000:0.0:1788201165.801103:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720062 expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201165.801137:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201165.801145:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3646:x1875064681171968:12345-0@lo:103: 00010000:00010000:0.0:1788201165.801154:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201165.801158:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720062 expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.801168:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720062 expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.801181:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201165.801212:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3646:x1875064681171968:12345-0@lo:103: Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.801219:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201165.801367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681171968:0@lo:103: 00010000:00010000:3.0:1788201165.802314:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720007 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.802330:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720007 expref: 21 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.802343:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681172096:0@lo:104: 00000100:00100000:3.0:1788201165.802384:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201165.802445:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.802472:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.802481:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681172224:0@lo:104: 00000100:00100000:3.0:1788201165.802500:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc46c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788201165.802519:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081671000/0xf9b71aee447200d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee447200d2 expref: 21 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.802533:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681170944:0@lo:104: 00010000:00010000:3.0:1788201165.802555:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081670a00/0xf9b71aee447200af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee447200a8 expref: 20 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.802563:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681171072:0@lo:104: 00010000:00010000:3.0:1788201165.802572:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75400/0xf9b71aee44720093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472008c expref: 19 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.802580:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823af480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681171200:0@lo:104: 00010000:00010000:3.0:1788201165.802589:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee44720069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720062 expref: 18 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.802703:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681171584:0@lo:104: 00000100:00100000:2.0:1788201165.802974:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201165.802996:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.803009:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681171712 00000100:00100000:2.0:1788201165.803015:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681171712 00000100:00100000:2.0:1788201165.803048:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681172096 00000100:00100000:2.0:1788201165.803050:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681172096 00000100:00100000:2.0:1788201165.803057:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681172224 00000100:00100000:2.0:1788201165.803059:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681172224 00000100:00100000:2.0:1788201165.803069:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201165.803077:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:6510:x1875064681171712:12345-0@lo:104: 00010000:00010000:2.0:1788201165.803155:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.803214:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201165.803220:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:6510:x1875064681171712:12345-0@lo:104: Request processed in 144us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.803227:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201165.803244:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201165.803249:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82023050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6510:x1875064681172096:12345-0@lo:104: 00010000:00010000:2.0:1788201165.803256:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.803281:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201165.803285:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82023050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6510:x1875064681172096:12345-0@lo:104: Request processed in 36us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.803298:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201165.803327:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201165.803332:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6510:x1875064681172224:12345-0@lo:104: 00010000:00010000:2.0:1788201165.803339:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.803364:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788201165.803369:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6510:x1875064681172224:12345-0@lo:104: Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.803373:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788201165.803456:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201165.803465:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803473:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74a00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201165.803478:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803488:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201165.803506:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201165.803512:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201165.803559:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803565:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201165.803611:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681172352:0@lo:103: 00000100:00100000:3.0:1788201165.803641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201165.803684:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803692:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44720046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472004d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803704:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201165.803707:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803712:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201165.803715:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803722:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201165.803729:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201165.803734:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201165.803778:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803784:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201165.803795:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803801:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1c00/0xf9b71aee44720007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472000e expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803821:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201165.803823:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803829:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201165.803832:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803838:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201165.803845:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201165.803850:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201165.803860:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803864:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201165.803868:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803884:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74000/0xf9b71aee4471ffdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ffe4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.803898:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.803899:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.803901:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.803907:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.803912:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201165.803947:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82606d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681171712:0@lo:104: 00000100:00100000:0.0:1788201165.803957:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681172096:0@lo:104: 00000100:00100000:0.0:1788201165.803964:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875064681172224:0@lo:104: 00010000:00010000:0.0:1788201165.803994:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201165.804316:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681172480:0@lo:103: 00000100:00100000:2.0:1788201165.804350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.804380:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201165.804385:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681172608:0@lo:103: 00000100:00100000:2.0:1788201165.804400:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.804493:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681172352 00000100:00100000:0.0:1788201165.804498:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681172352 00010000:00010000:0.0:1788201165.804521:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720046 expref: 18 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201165.804556:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681172480 00000100:00100000:0.0:1788201165.804559:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681172480 00010000:00010000:0.0:1788201165.804569:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720007 expref: 19 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201165.804580:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681172608 00000100:00100000:0.0:1788201165.804582:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681172608 00010000:00010000:0.0:1788201165.804673:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 20 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201165.804703:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201165.804711:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:3647:x1875064681172352:12345-0@lo:103: 00010000:00010000:0.0:1788201165.804723:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201165.804729:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720046 expref: 20 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.804762:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720046 expref: 20 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.804778:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75800/0xf9b71aee4472004d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720046 expref: 20 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.804792:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201165.804869:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:1.0:1788201165.804901:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201165.804910:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:3644:x1875064681172480:12345-0@lo:103: 00010000:00010000:1.0:1788201165.804918:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201165.804923:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720007 expref: 19 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.804932:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720007 expref: 19 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.804952:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081671200/0xf9b71aee4472000e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720007 expref: 19 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.804961:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201165.804991:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:3644:x1875064681172480:12345-0@lo:103: Request processed in 84us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.804997:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201165.805014:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201165.805019:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:3644:x1875064681172608:12345-0@lo:103: 00010000:00010000:1.0:1788201165.805025:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201165.805029:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 17 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805048:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 17 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805058:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a1600/0xf9b71aee4471ffe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ffdd expref: 17 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805070:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805078:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805103:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805111:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805118:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805125:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805130:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201165.805134:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805141:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805163:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.805172:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201165.805193:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:3644:x1875064681172608:12345-0@lo:103: Request processed in 174us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.805198:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201165.805251:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681172608:0@lo:103: 00000100:00100000:1.0:1788201165.805260:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681172480:0@lo:103: 00010000:00010000:1.0:1788201165.806046:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.806059:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.806066:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee447200ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201165.806093:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788201165.806776:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3647:x1875064681172352:12345-0@lo:103: Request processed in 2058us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.806788:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201165.807006:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681172352:0@lo:103: 00000100:00100000:1.0:1788201165.809414:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:9509:x1875064681170816:12345-0@lo:253: Request processed in 22637us (25809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.809431:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788201165.809438:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681170816:0@lo:253: 10000000:01000000:3.0:1788201165.809468:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788201165.809472:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201165.809474:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201165.809476:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201165.809477:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788201165.809478:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201165.809479:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201165.809481:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201165.809483:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788201165.809485:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201165.809486:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201165.809511:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cdf81977800 from lustre-OST0001 10000000:01000000:3.0:1788201165.809557:0:9509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788201165.809561:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788201165.809573:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0b2520000 local copy 10000000:01000000:3.0:1788201165.809578:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788201165.809908:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.809921:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.809933:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.809972:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681172736:0@lo:101: 00000100:00100000:3.0:1788201165.810020:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201165.810212:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201165.810436:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681172736 00000100:00100000:0.0:1788201165.810444:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681172736 00000100:00100000:0.0:1788201165.810549:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788201165.810562:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:9509:x1875064681172736:12345-0@lo:101: 00010000:00010000:0.0:1788201165.810581:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201165.810666:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74000/0xf9b71aee447200fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447200f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.810700:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74000/0xf9b71aee447200fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447200f5 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.810713:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74000/0xf9b71aee447200fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447200f5 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.810734:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74000, rc 0) 00000100:00100000:0.0:1788201165.810895:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681172736:12345-0@lo:101: Request processed in 335us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.810902:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788201165.811441:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681172736:0@lo:101: 00010000:00010000:1.0:1788201165.811464:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.811476:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201165.811762:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681172864:0@lo:501: 00000100:00100000:1.0:1788201165.811929:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.812014:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201165.812056:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681172864 00000100:00100000:0.0:1788201165.812063:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681172864 00000100:00100000:0.0:1788201165.812405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788201165.812416:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681172864:12345-0@lo:501: 00000100:00100000:0.0:1788201165.812517:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681172864:12345-0@lo:501: Request processed in 103us (588us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201165.812524:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788201165.812726:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681172864:0@lo:501: 10000000:01000000:1.0:1788201165.812784:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788201165.812947:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788201165.812956:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.812967:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.812974:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.813005:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201165.813037:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cdf81977800 10000000:01000000:1.0:1788201165.813043:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201165.813051:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788201165.813054:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201165.813059:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788201165.813062:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201165.813183:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201165.813193:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.813201:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201165.813205:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.813214:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201165.813222:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201165.813242:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201165.813266:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.813273:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201165.813297:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.813304:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0200/0xf9b71aee447200f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf9b71aee447200fc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.813326:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201165.813328:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201165.813329:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201165.813345:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681173120:0@lo:103: 00000100:00100000:2.0:1788201165.813392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.813449:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681173120 00000100:00100000:2.0:1788201165.813454:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681173120 00000100:00100000:2.0:1788201165.813499:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201165.813508:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3646:x1875064681173120:12345-0@lo:103: 00010000:00010000:2.0:1788201165.813519:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201165.813535:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74000/0xf9b71aee447200fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447200f5 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.813561:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201165.813715:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:3646:x1875064681173120:12345-0@lo:103: Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.813723:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201165.813891:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681173120:0@lo:103: 00010000:00010000:1.0:1788201165.813994:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.814004:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.814026:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201165.814041:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681172992:0@lo:101: 00000100:00100000:1.0:1788201165.814073:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.814294:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.814372:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681172992 00000100:00100000:3.0:1788201165.814380:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681172992 00000100:00100000:2.0:1788201165.814663:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788201165.814673:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+14:9509:x1875064681172992:12345-0@lo:101: 00010000:00010000:2.0:1788201165.814688:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201165.814705:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720103 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.814728:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720103 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.814967:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720103 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.814977:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0c2045c00, rc 0) 00000100:00100000:2.0:1788201165.815031:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681172992:12345-0@lo:101: Request processed in 359us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.815037:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201165.815177:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681172992:0@lo:101: 00010000:00010000:1.0:1788201165.815194:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.815205:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201165.815315:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173248:0@lo:501: 00000100:00100000:1.0:1788201165.815346:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.815773:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201165.816049:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681173248 00000100:00100000:0.0:1788201165.816057:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681173248 00000100:00100000:0.0:1788201165.816169:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788201165.816179:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173248:12345-0@lo:501: 00000100:00100000:0.0:1788201165.816397:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173248:12345-0@lo:501: Request processed in 219us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.816404:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201165.816482:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173248:0@lo:501: 00000100:00100000:1.0:1788201165.816523:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173376:0@lo:503: 00000100:00100000:1.0:1788201165.816703:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.816801:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201165.816953:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681173376 00000100:00100000:2.0:1788201165.816958:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681173376 00000100:00100000:3.0:1788201165.817042:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201165.817054:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173376:12345-0@lo:503: 00000100:00100000:3.0:1788201165.817284:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173376:12345-0@lo:503: Request processed in 233us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.817291:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201165.817378:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173376:0@lo:503: 00000040:00080000:1.0:1788201165.817697:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201165.817931:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173504:0@lo:502: 00000100:00100000:1.0:1788201165.817987:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.818278:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201165.818355:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681173504 00000100:00100000:0.0:1788201165.818362:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681173504 00000100:00100000:0.0:1788201165.818394:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788201165.818402:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173504:12345-0@lo:502: 00000100:00100000:0.0:1788201165.818527:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173504:12345-0@lo:502: Request processed in 125us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.818534:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788201165.818643:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173504:0@lo:502: 00000040:00080000:1.0:1788201165.818908:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788201165.818962:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788201165.818980:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788201165.818995:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788201165.819007:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788201165.819020:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788201165.819046:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173632:0@lo:502: 00000100:00100000:1.0:1788201165.819420:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.819437:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201165.819570:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681173632 00000100:00100000:0.0:1788201165.819576:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681173632 00000100:00100000:0.0:1788201165.819774:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788201165.819783:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173632:12345-0@lo:502: 00000100:00100000:0.0:1788201165.819998:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173632:12345-0@lo:502: Request processed in 216us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.820006:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788201165.820120:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173632:0@lo:502: 00000040:00080000:1.0:1788201165.820187:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788201165.820199:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788201165.821390:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201165.821403:0:9520:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788201165.821410:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201165.821412:0:9520:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788201165.821420:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201165.821438:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cdf821d0000) 00000020:00000080:1.0:1788201165.821483:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788201165.821492:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201165.821644:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cdf81977800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788201165.821654:0:9520:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201165.821661:0:9520:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf9b71aee44720118 00010000:00010000:1.0:1788201165.836229:0:9520:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1788201165.836714:0:9520:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788201165.841197:0:9520:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788201165.842021:0:9520:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788201165.857347:0:9520:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788201165.860456:0:9520:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788201165.869227:0:9520:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788201165.873236:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788201165.873256:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201165.873266:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201165.873268:0:9520:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788201165.873272:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201165.873277:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201165.873278:0:9520:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201165.873282:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201165.873284:0:9520:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201165.873317:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201165.873320:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201165.873321:0:9520:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788201165.873325:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788201165.873510:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788201165.873547:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788201165.873573:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.873587:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201165.873607:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cdf81977800 from 1 10000000:01000000:1.0:1788201165.873610:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201165.873659:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.873668:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.873682:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201165.873712:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173760:0@lo:101: 00000100:00100000:1.0:1788201165.873852:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.873911:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.874243:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681173760 00000100:00100000:3.0:1788201165.874252:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681173760 00000100:00100000:3.0:1788201165.874344:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201165.874356:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:9509:x1875064681173760:12345-0@lo:101: 00010000:00010000:3.0:1788201165.874375:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201165.874391:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472011f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.874422:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472011f expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.874434:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472011f expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.874442:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0200, rc 0) 00000100:00100000:3.0:1788201165.874494:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681173760:12345-0@lo:101: Request processed in 140us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.874500:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788201165.874811:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173760:0@lo:101: 00010000:00010000:0.0:1788201165.874830:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.874840:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201165.874965:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173888:0@lo:501: 00000100:00100000:0.0:1788201165.875008:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.878327:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f07000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201165.878475:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681173888 00000100:00100000:1.0:1788201165.878489:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681173888 00000100:00100000:1.0:1788201165.878565:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788201165.878577:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681173888:12345-0@lo:501: 00000100:00100000:1.0:1788201165.879246:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681173888:12345-0@lo:501: Request processed in 669us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.879256:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788201165.879658:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681173888:0@lo:501: 00000100:00100000:0.0:1788201165.879725:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174016:0@lo:503: 00000100:00100000:0.0:1788201165.883368:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.883662:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f07000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.883722:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681174016 00000100:00100000:3.0:1788201165.883917:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681174016 00000100:00100000:3.0:1788201165.884044:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201165.884056:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681174016:12345-0@lo:503: 00000100:00100000:3.0:1788201165.884247:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681174016:12345-0@lo:503: Request processed in 192us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.884255:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788201165.884985:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174016:0@lo:503: 00000040:00080000:0.0:1788201165.885432:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201165.885677:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174144:0@lo:502: 00000100:00100000:0.0:1788201165.888064:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.888190:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f07000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.888253:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681174144 00000100:00100000:3.0:1788201165.888264:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681174144 00000100:00100000:3.0:1788201165.888323:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788201165.888334:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681174144:12345-0@lo:502: 00000100:00100000:3.0:1788201165.888911:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681174144:12345-0@lo:502: Request processed in 575us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.888920:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788201165.889301:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174144:0@lo:502: 00000040:00080000:0.0:1788201165.889625:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788201165.889662:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788201165.889709:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174272:0@lo:502: 00000100:00100000:0.0:1788201165.889807:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.889843:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f07000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.889995:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681174272 00000100:00100000:3.0:1788201165.890003:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681174272 00000100:00100000:3.0:1788201165.890056:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201165.890065:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681174272:12345-0@lo:502: 00000100:00100000:3.0:1788201165.890191:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681174272:12345-0@lo:502: Request processed in 127us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.890198:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788201165.890368:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174272:0@lo:502: 00000040:00080000:0.0:1788201165.890419:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788201165.890429:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788201165.895817:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201165.895835:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201165.895838:0:9524:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201165.895847:0:9524:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cdf81977800 00000020:00000080:0.0:1788201165.895850:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201165.896046:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201165.896067:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201165.896069:0:9524:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788201165.896196:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788201165.896808:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788201165.896843:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201165.896868:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.896882:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201165.896962:0:9509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788201165.896966:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cdf81977800 10000000:01000000:2.0:1788201165.896979:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cdf81977800 10000000:01000000:2.0:1788201165.896983:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201165.896990:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cdf81977800 from 1 10000000:01000000:2.0:1788201165.896994:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201165.897041:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.897051:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.897064:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201165.897283:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174400:0@lo:101: 00000100:00100000:2.0:1788201165.897367:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.897417:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090043000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.897608:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681174400 00000100:00100000:3.0:1788201165.897618:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681174400 00000100:00100000:3.0:1788201165.897684:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788201165.897694:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9509:x1875064681174400:12345-0@lo:101: 00010000:00010000:3.0:1788201165.897712:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201165.897728:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472012d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.897793:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472012d expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.897804:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472012d expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201165.897813:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0e00, rc 0) 00000100:00100000:3.0:1788201165.898235:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174400:12345-0@lo:101: Request processed in 540us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.898243:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788201165.901994:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174400:0@lo:101: 00010000:00010000:2.0:1788201165.902035:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.902050:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201165.902322:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174528:0@lo:501: 00000100:00100000:3.0:1788201165.902408:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201165.902461:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201165.902534:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681174528 00000100:00100000:1.0:1788201165.902551:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681174528 00000100:00100000:1.0:1788201165.902916:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788201165.902927:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174528:12345-0@lo:501: 00000100:00100000:1.0:1788201165.903192:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174528:12345-0@lo:501: Request processed in 265us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.903200:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788201165.904441:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174528:0@lo:501: 00000100:00100000:0.0:1788201165.904508:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174656:0@lo:503: 00000100:00100000:0.0:1788201165.904608:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.904661:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f070c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.904772:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681174656 00000100:00100000:3.0:1788201165.904780:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681174656 00000100:00100000:3.0:1788201165.904825:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788201165.904835:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174656:12345-0@lo:503: 00000100:00100000:3.0:1788201165.904980:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174656:12345-0@lo:503: Request processed in 145us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.904988:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201165.905508:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174656:0@lo:503: 00000040:00080000:0.0:1788201165.906046:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201165.906249:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174784:0@lo:502: 00000100:00100000:0.0:1788201165.906320:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.906417:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.914786:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681174784 00000100:00100000:3.0:1788201165.914808:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681174784 00000100:00100000:3.0:1788201165.914907:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788201165.914920:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174784:12345-0@lo:502: 00000100:00100000:3.0:1788201165.915167:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174784:12345-0@lo:502: Request processed in 249us (8846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.915176:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788201165.915468:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174784:0@lo:502: 00000040:00080000:0.0:1788201165.915783:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788201165.915821:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788201165.915837:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788201165.915851:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788201165.915879:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788201165.915893:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788201165.915903:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788201165.915915:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788201165.915929:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788201165.915955:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788201165.915970:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788201165.915984:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788201165.915998:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788201165.916012:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788201165.916026:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788201165.916040:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788201165.916066:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788201165.916079:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788201165.916108:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788201165.916122:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788201165.916135:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788201165.916147:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788201165.916159:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788201165.916173:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788201165.916187:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788201165.916200:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788201165.916215:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788201165.916228:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788201165.916241:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788201165.916253:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788201165.916263:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788201165.916273:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788201165.916285:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788201165.916308:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788201165.916324:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788201165.916339:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788201165.916355:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788201165.916372:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788201165.916387:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788201165.916401:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788201165.916415:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788201165.916429:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788201165.916443:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788201165.916455:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788201165.916468:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788201165.916480:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788201165.916526:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174912:0@lo:502: 00000100:00100000:0.0:1788201165.916598:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.916644:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.917327:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681174912 00000100:00100000:3.0:1788201165.917337:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681174912 00000100:00100000:3.0:1788201165.917394:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788201165.917404:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174912:12345-0@lo:502: 00000100:00100000:3.0:1788201165.917564:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681174912:12345-0@lo:502: Request processed in 161us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.917572:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201165.920030:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681174912:0@lo:502: 00000040:00080000:1.0:1788201165.920182:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1788201165.920200:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788201165.921285:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788201165.921305:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cdf821d3380) 00000020:00000080:1.0:1788201165.921335:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788201165.921554:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cdf81977800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201165.921559:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cdf81977800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201165.921563:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cdf81977800 3 00010000:00080000:1.0:1788201165.921610:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf8263f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201165.923308:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788201165.923432:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788201165.923479:0:9525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201165.923497:0:9525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf9b71aee44720142 00000100:00080000:1.0:1788201165.923510:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201165.923517:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf8263f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201165.923566:0:9525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0834cb100 x1875064681175040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201165.923597:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788201165.926281:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681175040:0@lo:38: 00000100:00100000:0.0:1788201165.926376:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.926454:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681175040 00000100:00100000:0.0:1788201165.926462:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681175040 00000100:00100000:0.0:1788201165.926504:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201165.926513:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875064681175040:12345-0@lo:38: 00010000:00080000:0.0:1788201165.926545:0:8476:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788201165.926618:0:8476:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf9b71aee44720149 00000004:00100000:0.0:1788201165.926637:0:8476:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201165.926680:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf441800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201165.926774:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875064681175040:12345-0@lo:38: Request processed in 259us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.926783:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788201165.926836:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0834cb100 x1875064681175040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201165.926847:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201165.926857:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788201165.926877:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201165.926883:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201165.926886:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf8263f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201165.926893:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681175040:0@lo:38: 00000100:00100000:2.0:1788201165.929817:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681175168:0@lo:400: 00000100:00100000:2.0:1788201165.929922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.929977:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681175680:0@lo:400: 00000100:00100000:2.0:1788201165.930001:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.930038:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201165.930045:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681175552:0@lo:400: 00000100:00100000:2.0:1788201165.930093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.930114:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681176064:0@lo:400: 00000100:00100000:2.0:1788201165.930138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.930176:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681175424:0@lo:400: 00000100:00100000:2.0:1788201165.930201:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.930219:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681175936:0@lo:400: 00000100:00100000:2.0:1788201165.930237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.930258:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201165.930262:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681175296:0@lo:400: 00000100:00100000:2.0:1788201165.930282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.930297:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681175808:0@lo:400: 00000100:00100000:2.0:1788201165.930318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.930352:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681175552 00000100:00100000:2.0:1788201165.930361:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681175552 00000100:00100000:2.0:1788201165.930406:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681175296 00000100:00100000:2.0:1788201165.930409:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681175296 00000100:00100000:2.0:1788201165.930425:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201165.930435:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681175552:12345-0@lo:400: 00000100:00100000:2.0:1788201165.930502:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681175552:12345-0@lo:400: Request processed in 68us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.930510:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201165.930530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201165.930535:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681175296:12345-0@lo:400: 00000100:00100000:2.0:1788201165.930568:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681175296:12345-0@lo:400: Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.930574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201165.930602:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681176064 00000100:00100000:2.0:1788201165.930606:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681176064 00000100:00100000:2.0:1788201165.930641:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681175936 00000100:00100000:2.0:1788201165.930643:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681175936 00000100:00100000:2.0:1788201165.930660:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201165.930666:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681176064:12345-0@lo:400: 00000100:00100000:2.0:1788201165.930715:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681176064:12345-0@lo:400: Request processed in 48us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.930721:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201165.930733:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201165.930769:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681175936:12345-0@lo:400: 00000100:00100000:2.0:1788201165.930798:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681175936:12345-0@lo:400: Request processed in 58us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.930804:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201165.930850:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681175552:0@lo:400: 00010000:00080000:2.0:1788201165.930866:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82605880 x1875064681176064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201165.930877:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681176064:0@lo:400: 00000100:00080000:2.0:1788201165.930909:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201165.930930:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681175296:0@lo:400: 00010000:00080000:2.0:1788201165.930952:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82604000 x1875064681175936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201165.930960:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681175936:0@lo:400: 00000100:00100000:0.0:1788201165.931791:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681175168 00000100:00100000:0.0:1788201165.931802:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681175168 00000100:00100000:0.0:1788201165.931840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681175680 00000100:00100000:0.0:1788201165.931843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681175680 00000100:00100000:0.0:1788201165.932189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681175424 00000100:00100000:0.0:1788201165.932205:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681175424 00000100:00100000:0.0:1788201165.932221:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681175808 00000100:00100000:0.0:1788201165.932223:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681175808 00000100:00100000:0.0:1788201165.932241:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201165.932250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681175168:12345-0@lo:400: 00000100:00100000:0.0:1788201165.932341:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681175168:12345-0@lo:400: Request processed in 92us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.932348:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201165.932364:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201165.932370:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681175680:12345-0@lo:400: 00000100:00100000:0.0:1788201165.932398:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681175680:12345-0@lo:400: Request processed in 28us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.932403:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201165.932414:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201165.932419:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681175424:12345-0@lo:400: 00000100:00100000:0.0:1788201165.932451:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681175424:12345-0@lo:400: Request processed in 32us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.932456:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201165.932466:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201165.932472:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681175808:12345-0@lo:400: 00000100:00100000:0.0:1788201165.932499:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681175808:12345-0@lo:400: Request processed in 28us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.932505:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788201165.932566:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82606a00 x1875064681175168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201165.932580:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681175168:0@lo:400: 00010000:00080000:0.0:1788201165.932627:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82604700 x1875064681175680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201165.932637:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681175680:0@lo:400: 00010000:00080000:0.0:1788201165.932674:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82604380 x1875064681175808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201165.932683:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681175808:0@lo:400: 00010000:00080000:0.0:1788201165.932706:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf82604e00 x1875064681175424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201165.932715:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681175424:0@lo:400: 00000100:00080000:2.0:1788201165.933550:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201165.933557:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:1.0:1788201165.938550:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:2.0:1788201165.938879:0:9526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1875064681176192:0@lo:901: 00000100:00100000:2.0:1788201165.938990:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.939032:0:9526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090043cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201165.939221:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681176192 00000100:00100000:3.0:1788201165.939231:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681176192 00000100:00100000:3.0:1788201165.939306:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201165.939318:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1875064681176192:12345-0@lo:901: 00000100:00100000:3.0:1788201165.939431:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1875064681176192:12345-0@lo:901: Request processed in 115us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.939438:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788201165.939985:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201165.940039:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf823ad500 x1875064681176192/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788201181 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201165.940056:0:9526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1875064681176192:0@lo:901: 00000020:00000080:1.0:1788201165.940302:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9cdf831e8000) 00000020:00000080:1.0:1788201165.940335:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788201165.940583:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cdf81977800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201165.943448:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cdf81977800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201165.943457:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cdf81977800 3 00010000:00080000:1.0:1788201165.943532:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf831fa800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1788201165.952895:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788201165.953029:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788201165.953088:0:9525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201165.953103:0:9525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf9b71aee44720157 00000100:00080000:0.0:1788201165.953117:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201165.953124:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cdf831fa800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201165.953169:0:9525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c8a300 x1875064681176320/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201165.953220:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681176320:0@lo:38: 00000100:00100000:0.0:1788201165.953304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.953377:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681176320 00000100:00100000:0.0:1788201165.953385:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681176320 00000100:00100000:0.0:1788201165.953418:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201165.953426:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875064681176320:12345-0@lo:38: 00010000:00080000:0.0:1788201165.953455:0:6516:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788201165.953510:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf9b71aee4472015e 00000004:00100000:0.0:1788201165.953526:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201165.953561:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9cdf82638000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201165.953622:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875064681176320:12345-0@lo:38: Request processed in 193us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.953629:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788201165.953672:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b6c8a300 x1875064681176320/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201165.953682:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201165.953691:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788201165.953699:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201165.953703:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788201165.953706:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf831fa800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201165.953712:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681176320:0@lo:38: 00000100:00080000:0.0:1788201165.953732:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788201165.966006:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1788201165.966390:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788201165.966426:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201165.967435:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.967453:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201165.967519:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201165.967521:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201165.967522:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201165.967524:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201165.967525:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201165.967532:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201165.967533:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201165.967535:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201165.967536:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201165.967538:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201165.967539:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201165.967543:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788201165.967546:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201165.967548:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201165.967549:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201165.967550:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201165.967550:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201165.967552:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201165.967553:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201165.967554:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788201165.967554:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788201165.967555:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201165.967556:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201165.967591:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788201165.967613:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681176448:0@lo:253: 00000100:00100000:0.0:1788201165.967730:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.967798:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201165.967825:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681176448 00000100:00100000:0.0:1788201165.967834:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681176448 00000100:00100000:0.0:1788201165.967887:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201165.967898:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681176448:12345-0@lo:253: 20000000:01000000:0.0:1788201165.967931:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788201165.967958:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201165.984656:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201165.984680:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788201165.985025:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201165.985032:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201165.985059:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.985092:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720054 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.985102:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472009a expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.985109:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.985157:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472009a expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.985173:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472009a expref: 17 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201165.985191:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681176576:0@lo:104: 00000100:00100000:2.0:1788201165.985267:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201165.985323:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720054 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201165.985351:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720054 expref: 17 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201165.985360:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681176704:0@lo:104: 00000100:00100000:2.0:1788201165.985394:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.985412:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201165.985561:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681176576 00000100:00100000:1.0:1788201165.985570:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681176576 00000100:00100000:1.0:1788201165.985619:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681176704 00000100:00100000:1.0:1788201165.985623:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681176704 00000100:00100000:1.0:1788201165.985641:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201165.985650:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6531:x1875064681176576:12345-0@lo:104: 00010000:00010000:1.0:1788201165.985666:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.985762:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201165.985768:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:6531:x1875064681176576:12345-0@lo:104: Request processed in 120us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.985776:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201165.985800:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201165.985806:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6531:x1875064681176704:12345-0@lo:104: 00010000:00010000:1.0:1788201165.985814:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201165.985844:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201165.985849:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:6531:x1875064681176704:12345-0@lo:104: Request processed in 43us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.985854:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201165.985897:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681176576:0@lo:104: 00000100:00100000:1.0:1788201165.985919:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875064681176704:0@lo:104: 00010000:00010000:1.0:1788201165.985955:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201165.986178:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9509:x1875064681176448:12345-0@lo:253: Request processed in 18281us (18447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.986187:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788201165.986315:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9509:1875064681176448:0@lo:253: 10000000:01000000:1.0:1788201165.986327:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788201165.986331:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201165.986333:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201165.986334:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201165.986335:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201165.986336:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201165.986338:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201165.986339:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201165.986341:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201165.986342:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201165.986344:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201165.986345:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201165.986360:0:9509:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788201165.987897:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201165.987912:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.987926:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2045000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201165.987931:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.987976:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201165.987985:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201165.987991:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201165.988055:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988062:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201165.988102:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988110:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472009a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447200a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988131:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201165.988135:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988140:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74600 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201165.988143:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988149:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201165.988156:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201165.988180:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201165.988196:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988201:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201165.988218:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988225:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee44720054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472005b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988240:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.988242:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.988244:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201165.988250:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201165.988287:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681176832:0@lo:103: 00000100:00100000:0.0:1788201165.988361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.988436:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681176960:0@lo:103: 00000100:00100000:0.0:1788201165.988458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.988494:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681176832 00000100:00100000:0.0:1788201165.988502:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681176832 00010000:00010000:0.0:1788201165.988534:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472009a expref: 17 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201165.988562:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681176960 00000100:00100000:0.0:1788201165.988565:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681176960 00010000:00010000:0.0:1788201165.988575:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720054 expref: 18 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201165.988606:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201165.988616:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:3647:x1875064681176832:12345-0@lo:103: 00010000:00010000:0.0:1788201165.988632:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201165.988637:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472009a expref: 18 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988648:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472009a expref: 18 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988663:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081670200/0xf9b71aee447200a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472009a expref: 18 pid: 6510 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988678:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201165.988715:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:3647:x1875064681176832:12345-0@lo:103: Request processed in 100us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.988722:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201165.988769:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201165.988776:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:3644:x1875064681176960:12345-0@lo:103: 00010000:00010000:0.0:1788201165.988784:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201165.988788:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720054 expref: 16 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988796:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720054 expref: 16 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988805:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081670c00/0xf9b71aee4472005b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720054 expref: 16 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988827:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988835:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201165.988853:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016838863s 00010000:00010000:0.0:1788201165.988858:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988865:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988872:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988878:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988883:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2045e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201165.988888:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988895:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988910:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.988920:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201165.988965:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3644:x1875064681176960:12345-0@lo:103: Request processed in 189us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.988972:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201165.989042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681176832:0@lo:103: 00000100:00100000:0.0:1788201165.989071:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681176960:0@lo:103: 00010000:00010000:0.0:1788201165.989088:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.989096:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201165.989102:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0c2045e00/0xf9b71aee44720165 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788201165.998382:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788201165.998601:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788201165.998920:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788201165.999161:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788201165.999379:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788201165.999641:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788201166.002064:0:9509:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788201166.010076:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788201166.011520:0:9509:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788201166.011529:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788201166.011573:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201166.011642:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201166.011665:0:9509:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788201166.011690:0:9509:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788201166.013319:0:9509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201166.013565:0:9509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788201166.454293:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201166.454329:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681177088:0@lo:41: 00000100:00100000:3.0:1788201166.454419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201166.454561:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681177088 00000100:00100000:2.0:1788201166.454569:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681177088 00000100:00100000:2.0:1788201166.454624:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201166.454635:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681177088:12345-0@lo:41: 00000100:00100000:1.0:1788201166.454913:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681177216:0@lo:41: 00000100:00100000:1.0:1788201166.454979:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201166.455111:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788201166.455124:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:2.0:1788201166.455217:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788201166.455274:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681177088:12345-0@lo:41: Request processed in 641us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201166.455282:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201166.455302:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681177216 00000100:00100000:2.0:1788201166.455306:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681177216 00000100:00100000:2.0:1788201166.455325:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201166.455332:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681177216:12345-0@lo:41: 00000004:00000024:2.0:1788201166.455351:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788201166.455609:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681177088:0@lo:41: 00000100:00100000:2.0:1788201166.456133:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681177216:12345-0@lo:41: Request processed in 797us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201166.456140:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201166.456263:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681177216:0@lo:41: 00000100:00100000:2.0:1788201166.971888:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681177344:0@lo:13: 00000100:00100000:2.0:1788201166.972003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201166.972092:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681177472:0@lo:13: 00000100:00100000:2.0:1788201166.972118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201166.972156:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681177344 00000100:00100000:2.0:1788201166.972165:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681177344 00000100:00100000:2.0:1788201166.972214:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681177472 00000100:00100000:2.0:1788201166.972217:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681177472 00000100:00100000:2.0:1788201166.972233:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201166.972243:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681177344:12345-0@lo:13: 00002000:00000024:2.0:1788201166.972283:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201166.972333:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681177344:12345-0@lo:13: Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201166.972341:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201166.972360:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201166.972367:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681177472:12345-0@lo:13: 00002000:00000024:2.0:1788201166.972377:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201166.972406:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681177472:12345-0@lo:13: Request processed in 40us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201166.972412:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788201166.972454:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333c000 x1875064681177472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201166.972476:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681177472:0@lo:13: 00010000:00080000:2.0:1788201166.972512:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333c380 x1875064681177344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201166.972524:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681177344:0@lo:13: 00010000:00010000:0.0:1788201167.031968:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201167.070377:0:9582:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201167.070718:0:9582:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201168.056500:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201169.078546:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201170.101950:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201171.062031:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681177984:0@lo:400: 00000100:00100000:3.0:1788201171.062128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062197:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681178496:0@lo:400: 00000100:00100000:3.0:1788201171.062224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062261:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201171.062267:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681177600:0@lo:400: 00000100:00100000:3.0:1788201171.062297:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062320:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681178112:0@lo:400: 00000100:00100000:3.0:1788201171.062345:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062363:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681178624:0@lo:400: 00000100:00100000:3.0:1788201171.062383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062412:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681177728:0@lo:400: 00000100:00100000:3.0:1788201171.062459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062476:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681178240:0@lo:400: 00000100:00100000:3.0:1788201171.062495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062510:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681178752:0@lo:400: 00000100:00100000:3.0:1788201171.062562:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062584:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201171.062589:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681177856:0@lo:400: 00000100:00100000:3.0:1788201171.062610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062625:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681178368:0@lo:400: 00000100:00100000:3.0:1788201171.062643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062653:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681178880:0@lo:400: 00000100:00100000:3.0:1788201171.062673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.062713:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681177984 00000100:00100000:3.0:1788201171.062722:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681177984 00000100:00100000:3.0:1788201171.062800:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681177728 00000100:00100000:3.0:1788201171.062804:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681177728 00000100:00100000:3.0:1788201171.062816:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681178240 00000100:00100000:3.0:1788201171.062819:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681178240 00000100:00100000:3.0:1788201171.062847:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681178752 00000100:00100000:3.0:1788201171.062850:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681178752 00000100:00100000:3.0:1788201171.062867:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681178368 00000100:00100000:3.0:1788201171.062870:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681178368 00000100:00100000:3.0:1788201171.062888:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681178880 00000100:00100000:3.0:1788201171.062890:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681178880 00000100:00100000:0.0:1788201171.062920:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681178112 00000100:00100000:3.0:1788201171.062926:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201171.062927:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681178112 00000100:00100000:3.0:1788201171.062941:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681177984:12345-0@lo:400: 00000100:00100000:0.0:1788201171.062965:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681177856 00000100:00100000:0.0:1788201171.062969:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681177856 00000100:00100000:0.0:1788201171.062987:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201171.062997:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681178112:12345-0@lo:400: 00000100:00100000:3.0:1788201171.063013:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681177984:12345-0@lo:400: Request processed in 75us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063032:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201171.063050:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681178112:12345-0@lo:400: Request processed in 55us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063058:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201171.063062:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201171.063069:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681177728:12345-0@lo:400: 00000100:00100000:0.0:1788201171.063080:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201171.063089:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681177856:12345-0@lo:400: 00000100:00100000:3.0:1788201171.063110:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681177728:12345-0@lo:400: Request processed in 44us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063117:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201171.063136:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201171.063140:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681177856:12345-0@lo:400: Request processed in 49us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063149:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681178240:12345-0@lo:400: 00000100:00100000:0.0:1788201171.063153:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201171.063186:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681178240:12345-0@lo:400: Request processed in 42us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201171.063209:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201171.063216:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681178752:12345-0@lo:400: 00000100:00100000:3.0:1788201171.063245:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681178752:12345-0@lo:400: Request processed in 29us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063252:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201171.063265:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201171.063273:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681178368:12345-0@lo:400: 00000100:00100000:3.0:1788201171.063301:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681178368:12345-0@lo:400: Request processed in 30us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201171.063317:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201171.063323:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681178880:12345-0@lo:400: 00000100:00100000:3.0:1788201171.063349:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681178880:12345-0@lo:400: Request processed in 26us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063364:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201171.063385:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681178496 00000100:00100000:3.0:1788201171.063389:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681178496 00000100:00100000:3.0:1788201171.063426:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681178624 00000100:00100000:3.0:1788201171.063429:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681178624 00000100:00100000:3.0:1788201171.063451:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201171.063458:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681178496:12345-0@lo:400: 00000100:00100000:3.0:1788201171.063492:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681178496:12345-0@lo:400: Request processed in 35us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063498:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201171.063509:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201171.063515:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681178624:12345-0@lo:400: 00000100:00100000:3.0:1788201171.063541:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681178624:12345-0@lo:400: Request processed in 27us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063547:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201171.063568:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681177600 00000100:00100000:3.0:1788201171.063571:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681177600 00000100:00100000:3.0:1788201171.063595:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788201171.063602:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3644:x1875064681177600:12345-0@lo:400: 00000100:00100000:3.0:1788201171.063631:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3644:x1875064681177600:12345-0@lo:400: Request processed in 30us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.063638:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1788201171.063691:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201171.063696:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201171.063699:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201171.063784:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681177856:0@lo:400: 00010000:00080000:3.0:1788201171.063800:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82604000 x1875064681178368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.063819:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681178368:0@lo:400: 00010000:00080000:3.0:1788201171.063832:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82607480 x1875064681178880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.063842:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681178880:0@lo:400: 00010000:00080000:3.0:1788201171.063857:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82605180 x1875064681177728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.063865:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681177728:0@lo:400: 00010000:00080000:3.0:1788201171.063875:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82606a00 x1875064681178240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.063883:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681178240:0@lo:400: 00010000:00080000:3.0:1788201171.063892:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82604a80 x1875064681178752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.063909:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681178752:0@lo:400: 00000100:00100000:3.0:1788201171.063950:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681177600:0@lo:400: 00000100:00100000:3.0:1788201171.063962:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681178112:0@lo:400: 00010000:00080000:3.0:1788201171.063972:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82605880 x1875064681178624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.063980:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681178624:0@lo:400: 00010000:00080000:3.0:1788201171.063990:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82604380 x1875064681177984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.063997:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681177984:0@lo:400: 00010000:00080000:3.0:1788201171.064015:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82607b80 x1875064681178496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.064023:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681178496:0@lo:400: 00010000:00010000:1.0:1788201171.125986:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201171.575484:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681179008:0@lo:41: 00000100:00100000:3.0:1788201171.575580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201171.575938:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681179008 00000100:00100000:2.0:1788201171.575948:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681179008 00000100:00100000:2.0:1788201171.576008:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201171.576018:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681179008:12345-0@lo:41: 00000004:00000024:2.0:1788201171.576058:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788201171.576111:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681179008:12345-0@lo:41: Request processed in 95us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201171.576118:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201171.576168:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681179008:0@lo:41: 00000100:00100000:1.0:1788201171.591187:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681179136:0@lo:41: 00000100:00100000:1.0:1788201171.591280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201171.591368:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681179136 00000100:00100000:1.0:1788201171.591377:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681179136 00000100:00100000:1.0:1788201171.591434:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201171.591445:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681179136:12345-0@lo:41: 00000004:00000024:1.0:1788201171.591494:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788201171.591546:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681179136:12345-0@lo:41: Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201171.591554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201171.591623:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681179136:0@lo:41: 00000100:00100000:2.0:1788201172.086110:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681179264:0@lo:13: 00000100:00100000:2.0:1788201172.086197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201172.086272:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681179264 00000100:00100000:2.0:1788201172.086279:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681179264 00000100:00100000:2.0:1788201172.086319:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201172.086326:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681179264:12345-0@lo:13: 00002000:00000024:2.0:1788201172.086355:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201172.086397:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681179264:12345-0@lo:13: Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201172.086404:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788201172.086445:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333c380 x1875064681179264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201172.086462:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681179264:0@lo:13: 00000100:00100000:2.0:1788201172.087071:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681179392:0@lo:13: 00000100:00100000:2.0:1788201172.087105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201172.087281:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681179392 00000100:00100000:1.0:1788201172.087287:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681179392 00000100:00100000:1.0:1788201172.087324:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201172.087333:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681179392:12345-0@lo:13: 00002000:00000024:1.0:1788201172.087348:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201172.087384:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681179392:12345-0@lo:13: Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201172.087390:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788201172.087470:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c9f80 x1875064681179392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201172.087499:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681179392:0@lo:13: 00010000:00010000:1.0:1788201172.153715:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201172.600932:0:9872:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788201173.174032:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201173.802218:0:9924:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201173.803637:0:9924:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201174.199382:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788201174.645798:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201174.645806:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0b95bd800 from 39 10000000:01000000:2.0:1788201174.645812:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201174.645866:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.645892:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.645906:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201174.645939:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681179520:0@lo:101: 00000100:00100000:2.0:1788201174.646029:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.646085:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.647934:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681179520 00000100:00100000:1.0:1788201174.647953:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681179520 00000100:00100000:1.0:1788201174.648039:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201174.648069:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681179520:12345-0@lo:101: 00010000:00010000:1.0:1788201174.648098:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201174.648121:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472016c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.648156:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472016c expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.648171:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472016c expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.648182:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081670c00, rc 0) 00000100:00100000:1.0:1788201174.648280:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681179520:12345-0@lo:101: Request processed in 219us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.648288:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788201174.648655:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681179520:0@lo:101: 00010000:00010000:0.0:1788201174.648678:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.648690:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201174.648804:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681179648:0@lo:501: 00000100:00100000:0.0:1788201174.648846:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.648898:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2ef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201174.649312:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681179648 00000100:00100000:2.0:1788201174.649320:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681179648 00000100:00100000:2.0:1788201174.649449:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201174.649458:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681179648:12345-0@lo:501: 00000100:00100000:2.0:1788201174.649630:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681179648:12345-0@lo:501: Request processed in 173us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.649637:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201174.650373:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681179648:0@lo:501: 00000100:00100000:2.0:1788201174.650427:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681179776:0@lo:503: 00000100:00100000:2.0:1788201174.650495:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.650566:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.650601:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681179776 00000100:00100000:0.0:1788201174.650606:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681179776 00000100:00100000:0.0:1788201174.650672:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201174.650682:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681179776:12345-0@lo:503: 00000100:00100000:0.0:1788201174.650827:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681179776:12345-0@lo:503: Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.650834:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201174.650926:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681179776:0@lo:503: 00000100:00100000:2.0:1788201174.651117:0:9962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9962:1875064681179904:0@lo:502: 00000100:00100000:2.0:1788201174.651157:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.656642:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681179904 00000100:00100000:1.0:1788201174.656665:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681179904 00000100:00100000:1.0:1788201174.656732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201174.656764:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9962:x1875064681179904:12345-0@lo:502: 00000100:00100000:1.0:1788201174.656984:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9962:x1875064681179904:12345-0@lo:502: Request processed in 223us (5824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.656992:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201174.658259:0:9962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201174.658299:0:9962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9962:1875064681179904:0@lo:502: 00000100:00100000:2.0:1788201174.660066:0:9962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9962:1875064681180032:0@lo:502: 00000100:00100000:2.0:1788201174.660165:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.660401:0:9962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.660454:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681180032 00000100:00100000:1.0:1788201174.660463:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681180032 00000100:00100000:3.0:1788201174.668121:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201174.668149:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9962:x1875064681180032:12345-0@lo:502: 00000100:00100000:3.0:1788201174.668382:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:9962:x1875064681180032:12345-0@lo:502: Request processed in 245us (8216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.668391:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788201174.668504:0:9962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9962:1875064681180032:0@lo:502: 00000040:00080000:2.0:1788201174.668543:0:9962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788201174.668679:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788201174.668704:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201174.668716:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.668728:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201174.668766:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788201174.668769:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788201174.668772:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201174.668811:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.668819:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.668838:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201174.668859:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180160:0@lo:101: 00000100:00100000:2.0:1788201174.668914:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.671355:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.671558:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681180160 00000100:00100000:0.0:1788201174.671572:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681180160 00000100:00100000:0.0:1788201174.671642:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788201174.671652:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681180160:12345-0@lo:101: 00010000:00010000:0.0:1788201174.671674:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201174.671719:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472017a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.671786:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472017a expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.671800:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472017a expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.671811:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75e00, rc 0) 00000100:00100000:0.0:1788201174.671917:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681180160:12345-0@lo:101: Request processed in 266us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.671924:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788201174.672102:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180160:0@lo:101: 00010000:00010000:1.0:1788201174.672121:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.672130:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201174.672244:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180288:0@lo:501: 00000100:00100000:1.0:1788201174.672296:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.672335:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.672510:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681180288 00000100:00100000:0.0:1788201174.672515:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681180288 00000100:00100000:0.0:1788201174.672539:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788201174.672544:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681180288:12345-0@lo:501: 00000100:00100000:0.0:1788201174.672694:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681180288:12345-0@lo:501: Request processed in 149us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.672701:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788201174.673636:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180288:0@lo:501: 00000100:00100000:1.0:1788201174.673685:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180416:0@lo:503: 00000100:00100000:1.0:1788201174.673774:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.673819:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.674113:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681180416 00000100:00100000:0.0:1788201174.674120:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681180416 00000100:00100000:0.0:1788201174.674155:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788201174.674164:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681180416:12345-0@lo:503: 00000100:00100000:0.0:1788201174.674294:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681180416:12345-0@lo:503: Request processed in 130us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.674469:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788201174.674526:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180416:0@lo:503: 00000100:00100000:0.0:1788201174.674733:0:9965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9965:1875064681180544:0@lo:502: 00000100:00100000:0.0:1788201174.674790:0:9965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.674810:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681180544 00000100:00100000:0.0:1788201174.674813:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681180544 00000100:00100000:0.0:1788201174.674830:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201174.674835:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9965:x1875064681180544:12345-0@lo:502: 00000100:00100000:0.0:1788201174.674919:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9965:x1875064681180544:12345-0@lo:502: Request processed in 82us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.674925:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201174.674951:0:9965:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2efd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.674962:0:9965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9965:1875064681180544:0@lo:502: 00000020:01000000:0.0:1788201174.674985:0:9965:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201174.674996:0:9965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201174.674998:0:9965:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201174.675004:0:9965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201174.675006:0:9965:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788201174.675019:0:9965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9965:1875064681180672:0@lo:502: 00000100:00100000:0.0:1788201174.675054:0:9965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.675074:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681180672 00000100:00100000:0.0:1788201174.675078:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681180672 00000100:00100000:0.0:1788201174.675095:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201174.675101:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9965:x1875064681180672:12345-0@lo:502: 00000100:00100000:0.0:1788201174.675163:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:9965:x1875064681180672:12345-0@lo:502: Request processed in 60us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.675169:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201174.675211:0:9965:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.675224:0:9965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9965:1875064681180672:0@lo:502: 00000020:01000000:0.0:1788201174.675248:0:9965:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201174.675251:0:9965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201174.675253:0:9965:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788201174.675257:0:9965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788201174.675446:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788201174.675471:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788201174.675482:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.675494:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201174.675506:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201174.675509:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce09e1da800 from 39 10000000:01000000:0.0:1788201174.675513:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201174.675543:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.675552:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.675562:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201174.675573:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180800:0@lo:101: 00000100:00100000:0.0:1788201174.675598:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.675610:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.675622:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681180800 00000100:00100000:0.0:1788201174.675625:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681180800 00000100:00100000:0.0:1788201174.675641:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201174.675647:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681180800:12345-0@lo:101: 00010000:00010000:0.0:1788201174.675661:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201174.675675:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720188 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.675701:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720188 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.675712:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720188 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.675722:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74400, rc 0) 00000100:00100000:0.0:1788201174.675776:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681180800:12345-0@lo:101: Request processed in 129us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.675782:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201174.675815:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180800:0@lo:101: 00010000:00010000:0.0:1788201174.675828:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.675837:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201174.675888:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180928:0@lo:501: 00000100:00100000:0.0:1788201174.675914:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.675927:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.675938:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681180928 00000100:00100000:0.0:1788201174.675941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681180928 00000100:00100000:0.0:1788201174.675957:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201174.675963:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681180928:12345-0@lo:501: 00000100:00100000:0.0:1788201174.676082:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681180928:12345-0@lo:501: Request processed in 118us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.676089:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201174.676120:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681180928:0@lo:501: 00000100:00100000:0.0:1788201174.676140:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181056:0@lo:503: 00000100:00100000:0.0:1788201174.676490:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.676560:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.677239:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681181056 00000100:00100000:1.0:1788201174.677248:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681181056 00000100:00100000:1.0:1788201174.677286:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788201174.677295:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681181056:12345-0@lo:503: 00000100:00100000:1.0:1788201174.677531:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681181056:12345-0@lo:503: Request processed in 236us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.677538:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788201174.677641:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181056:0@lo:503: 00000100:00100000:0.0:1788201174.678142:0:9966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9966:1875064681181184:0@lo:502: 00000100:00100000:0.0:1788201174.678210:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.678251:0:9966:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.678414:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681181184 00000100:00100000:1.0:1788201174.678421:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681181184 00000100:00100000:1.0:1788201174.678447:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201174.678455:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:9966:x1875064681181184:12345-0@lo:502: 00000100:00100000:1.0:1788201174.678557:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:9966:x1875064681181184:12345-0@lo:502: Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.678563:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788201174.678646:0:9966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9966:1875064681181184:0@lo:502: 00000100:00100000:0.0:1788201174.678699:0:9966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9966:1875064681181312:0@lo:502: 00000100:00100000:0.0:1788201174.678731:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.678827:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681181312 00000100:00100000:1.0:1788201174.678832:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681181312 00000100:00100000:1.0:1788201174.678851:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201174.678858:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:9966:x1875064681181312:12345-0@lo:502: 00000100:00100000:1.0:1788201174.679024:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:9966:x1875064681181312:12345-0@lo:502: Request processed in 166us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.679031:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788201174.679724:0:9966:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.679780:0:9966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9966:1875064681181312:0@lo:502: 00000040:00080000:0.0:1788201174.679815:0:9966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788201174.680382:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788201174.680406:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201174.680420:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.680433:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201174.680444:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201174.680447:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce09e1da800 from 6 10000000:01000000:1.0:1788201174.680451:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201174.680488:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.680496:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.680507:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201174.680527:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181440:0@lo:101: 00000100:00100000:1.0:1788201174.680583:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.680658:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.680706:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681181440 00000100:00100000:0.0:1788201174.680713:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681181440 00000100:00100000:0.0:1788201174.681005:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788201174.681017:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681181440:12345-0@lo:101: 00010000:00010000:0.0:1788201174.681034:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201174.681051:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75a00/0xf9b71aee4472019d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720196 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.681091:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75a00/0xf9b71aee4472019d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720196 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.681103:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75a00/0xf9b71aee4472019d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720196 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.681114:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75a00, rc 0) 00000100:00100000:0.0:1788201174.681210:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681181440:12345-0@lo:101: Request processed in 195us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.681218:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201174.683434:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181440:0@lo:101: 00010000:00010000:1.0:1788201174.683470:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.683498:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201174.683576:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181568:0@lo:256: 00000100:00100000:1.0:1788201174.683645:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.683976:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.684193:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681181568 00000100:00100000:0.0:1788201174.684201:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681181568 00000100:00100000:0.0:1788201174.684259:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201174.684271:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681181568:12345-0@lo:256: 20000000:01000000:0.0:1788201174.684298:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201174.684320:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201174.684323:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788201174.684427:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681181568:12345-0@lo:256: Request processed in 159us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.684435:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201174.684498:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181568:0@lo:256: 10000000:01000000:0.0:1788201174.684551:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201174.684559:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.684568:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201174.684587:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788201174.684590:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788201174.684593:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201174.684626:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.684634:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201174.684643:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201174.684657:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181696:0@lo:101: 00000100:00100000:0.0:1788201174.684685:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.684710:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba1100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.685375:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681181696 00000100:00100000:1.0:1788201174.685383:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681181696 00000100:00100000:1.0:1788201174.685408:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201174.685415:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681181696:12345-0@lo:101: 00010000:00010000:1.0:1788201174.685426:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201174.685442:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447201a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.685466:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.685477:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.685486:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081670a00, rc 0) 00000100:00100000:1.0:1788201174.685537:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681181696:12345-0@lo:101: Request processed in 121us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.685543:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201174.685677:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181696:0@lo:101: 00010000:00010000:1.0:1788201174.685694:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.685715:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201174.685814:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181824:0@lo:501: 00000100:00100000:1.0:1788201174.685843:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.685869:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.685891:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681181824 00000100:00100000:1.0:1788201174.685894:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681181824 00000100:00100000:1.0:1788201174.685912:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201174.685918:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681181824:12345-0@lo:501: 00000100:00100000:1.0:1788201174.686055:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681181824:12345-0@lo:501: Request processed in 137us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.686062:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201174.686085:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181824:0@lo:501: 00000100:00100000:1.0:1788201174.686114:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181952:0@lo:503: 00000100:00100000:1.0:1788201174.686153:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.689534:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201174.689729:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681181952 00000100:00100000:2.0:1788201174.689750:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681181952 00000100:00100000:2.0:1788201174.689809:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201174.689820:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681181952:12345-0@lo:503: 00000100:00100000:2.0:1788201174.690007:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681181952:12345-0@lo:503: Request processed in 189us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.690015:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201174.690112:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681181952:0@lo:503: 00000100:00100000:0.0:1788201174.694013:0:9969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9969:1875064681182080:0@lo:502: 00000100:00100000:0.0:1788201174.694123:0:9969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.694655:0:9969:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201174.695967:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681182080 00000100:00100000:3.0:1788201174.695982:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681182080 00000100:00100000:3.0:1788201174.696669:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788201174.696682:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:9969:x1875064681182080:12345-0@lo:502: 00000100:00100000:3.0:1788201174.696993:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:9969:x1875064681182080:12345-0@lo:502: Request processed in 313us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.697436:0:9969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9969:1875064681182080:0@lo:502: 00000020:01000000:0.0:1788201174.697491:0:9969:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201174.697501:0:9969:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788201174.697513:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201174.697516:0:9969:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788201174.697524:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201174.697529:0:9969:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:0.0:1788201174.697562:0:9969:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788201174.697567:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201174.697594:0:9969:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ce0c15019c0) 00000020:00000080:0.0:1788201174.697754:0:9969:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788201174.697762:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788201174.697989:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000004:00080000:0.0:1788201174.698367:0:9969:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788201174.698376:0:9969:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788201174.698384:0:9969:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee447201b9 00010000:00080000:0.0:1788201174.698419:0:9969:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf83355800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1788201174.698652:0:9969:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788201174.698841:0:9969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788201174.698858:0:9969:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788201174.699079:0:9969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201174.700117:0:9969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201174.700373:0:9969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788201174.700468:0:9969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788201174.700817:0:9971:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788201174.700823:0:9971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788201174.702540:0:9969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201174.702557:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201174.702684:0:9969:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201174.702715:0:9969:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee447201c0 00000100:00080000:3.0:1788201174.702729:0:9969:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201174.702735:0:9969:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cdf83355800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201174.703402:0:9969:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf825fca80 x1875064681182208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201174.703479:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681182208:0@lo:8: 00000100:00100000:2.0:1788201174.703580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201174.703659:0:9969:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788201174.704441:0:9969:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201174.704451:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201174.704453:0:9969:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201174.704458:0:9969:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201174.704462:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201174.704464:0:9969:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201174.704467:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201174.704469:0:9969:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788201174.704503:0:9969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9969:1875064681182336:0@lo:502: 00000100:00100000:3.0:1788201174.704567:0:9969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.704599:0:9969:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201174.704626:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681182208 00000100:00100000:3.0:1788201174.704633:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681182208 00000100:00100000:3.0:1788201174.705379:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201174.705388:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875064681182208:12345-0@lo:8: 00010000:00080000:3.0:1788201174.705422:0:8432:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1788201174.705455:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee447201c7 00002000:00100000:3.0:1788201174.705471:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ce0bf45f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788201174.705476:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788201174.705480:0:8432:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788201174.705553:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201174.706005:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788201174.706036:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201174.706127:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681182208:12345-0@lo:8: Request processed in 738us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.706136:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788201174.706309:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fca80 x1875064681182208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.706321:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201174.706331:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788201174.706339:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201174.706346:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201174.706348:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf83355800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201174.706369:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201174.706374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681182208:0@lo:8: 00000100:00100000:1.0:1788201174.706404:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681182336 00000100:00100000:3.0:1788201174.706406:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681182464:0@lo:400: 00000100:00100000:1.0:1788201174.706411:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681182336 00000100:00100000:3.0:1788201174.706440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.706449:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201174.706456:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:9969:x1875064681182336:12345-0@lo:502: 00000100:00100000:3.0:1788201174.706464:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681182976:0@lo:400: 00000100:00100000:3.0:1788201174.706484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.706499:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681183488:0@lo:400: 00000100:00100000:3.0:1788201174.706517:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.706534:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201174.706539:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681182592:0@lo:400: 00000100:00100000:3.0:1788201174.706562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.706577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681183104:0@lo:400: 00000100:00100000:1.0:1788201174.706577:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:9969:x1875064681182336:12345-0@lo:502: Request processed in 121us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.706584:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788201174.706596:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.706610:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681183616:0@lo:400: 00000100:00100000:3.0:1788201174.706627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.706648:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681182720:0@lo:400: 00000100:00100000:3.0:1788201174.706667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.706678:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681183232:0@lo:400: 00000004:00080000:0.0:1788201174.707396:0:9971:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201174.707474:0:9971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 255004735045ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788201174.707482:0:9971:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788201174.707532:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1875064681183744:0@lo:700: 00000100:00100000:2.0:1788201174.707570:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.707600:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681183744 00000100:00100000:2.0:1788201174.707605:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681183744 00000100:00100000:2.0:1788201174.707649:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201174.707658:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9972:x1875064681183744:12345-0@lo:700: 00000100:00100000:2.0:1788201174.707689:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1875064681183872:0@lo:700: 00000100:00100000:2.0:1788201174.707715:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.707840:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201174.707933:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201174.707988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.708057:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201174.708064:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681182848:0@lo:400: 00000100:00100000:3.0:1788201174.708091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.708112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681183360:0@lo:400: 00000100:00100000:3.0:1788201174.708132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.708234:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681182464 00000100:00100000:3.0:1788201174.708240:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681182464 00000100:00100000:3.0:1788201174.708265:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681182976 00000100:00100000:3.0:1788201174.708268:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681182976 00000100:00100000:3.0:1788201174.708279:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681183488 00000100:00100000:3.0:1788201174.708282:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681183488 00000100:00100000:3.0:1788201174.708292:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681183104 00000100:00100000:3.0:1788201174.708295:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681183104 00000100:00100000:3.0:1788201174.708305:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681183616 00000100:00100000:3.0:1788201174.708308:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681183616 00000100:00100000:3.0:1788201174.708319:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681182720 00000100:00100000:3.0:1788201174.708322:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681182720 00000100:00100000:3.0:1788201174.708335:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201174.708342:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681182464:12345-0@lo:400: 00000100:00100000:3.0:1788201174.708390:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681182464:12345-0@lo:400: Request processed in 49us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.708397:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201174.708415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201174.708421:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681182976:12345-0@lo:400: 00000100:00100000:3.0:1788201174.708446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681182976:12345-0@lo:400: Request processed in 26us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.708451:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201174.708461:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201174.708473:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681183488:12345-0@lo:400: 00000100:00100000:3.0:1788201174.708502:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681183488:12345-0@lo:400: Request processed in 29us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.708507:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201174.708517:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201174.708522:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681183104:12345-0@lo:400: 00000100:00100000:3.0:1788201174.708544:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681183104:12345-0@lo:400: Request processed in 22us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.708550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201174.708560:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201174.708566:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681183616:12345-0@lo:400: 00000100:00100000:3.0:1788201174.708591:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681183616:12345-0@lo:400: Request processed in 25us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.708596:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201174.708605:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201174.708610:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681182720:12345-0@lo:400: 00000100:00100000:3.0:1788201174.708639:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681182720:12345-0@lo:400: Request processed in 28us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.708645:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201174.708674:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681182592 00000100:00100000:3.0:1788201174.708678:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681182592 00000100:00100000:3.0:1788201174.708701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681182848 00000100:00100000:3.0:1788201174.708704:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681182848 00000100:00100000:3.0:1788201174.708717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201174.708723:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681182592:12345-0@lo:400: 00000100:00100000:0.0:1788201174.708801:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681183872 00000100:00100000:0.0:1788201174.708806:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681183872 00000100:00100000:0.0:1788201174.708835:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201174.708842:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1875064681183872:12345-0@lo:700: 00000100:00100000:3.0:1788201174.708954:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681182592:12345-0@lo:400: Request processed in 123us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.708969:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201174.708982:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201174.708988:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681182848:12345-0@lo:400: 00000100:00100000:3.0:1788201174.709015:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681182848:12345-0@lo:400: Request processed in 29us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.709021:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788201174.709041:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201174.709045:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201174.709047:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201174.709102:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681183232 00000100:00100000:2.0:1788201174.709107:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681183232 00000100:00100000:2.0:1788201174.709138:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681183360 00000100:00100000:2.0:1788201174.709141:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681183360 00000100:00100000:2.0:1788201174.709158:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201174.709163:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681183232:12345-0@lo:400: 00000100:00100000:2.0:1788201174.709198:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681183232:12345-0@lo:400: Request processed in 35us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.709204:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201174.709216:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201174.709222:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681183360:12345-0@lo:400: 00000100:00100000:2.0:1788201174.709247:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681183360:12345-0@lo:400: Request processed in 25us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.709252:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201174.709329:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681182592:0@lo:400: 00010000:00080000:3.0:1788201174.709346:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fd180 x1875064681183104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.709358:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681183104:0@lo:400: 00010000:00080000:3.0:1788201174.709369:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825ff800 x1875064681183616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.709377:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681183616:0@lo:400: 00010000:00080000:3.0:1788201174.709387:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fc380 x1875064681182464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.709395:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681182464:0@lo:400: 00010000:00080000:3.0:1788201174.709404:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fe680 x1875064681182976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.709411:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681182976:0@lo:400: 00010000:00080000:3.0:1788201174.709420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825ff100 x1875064681183488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.709435:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681183488:0@lo:400: 00000100:00100000:3.0:1788201174.709489:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681182848:0@lo:400: 00010000:00080000:3.0:1788201174.709499:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fe300 x1875064681183360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.709507:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681183360:0@lo:400: 00010000:00080000:3.0:1788201174.709517:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fd880 x1875064681182720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.709524:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681182720:0@lo:400: 00010000:00080000:3.0:1788201174.709533:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fed80 x1875064681183232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.709539:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681183232:0@lo:400: 00000100:00080000:3.0:1788201174.709564:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201174.709590:0:9969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9969:1875064681182336:0@lo:502: 00000020:01000000:3.0:1788201174.709624:0:9969:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201174.709631:0:9969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201174.709634:0:9969:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788201174.709638:0:9969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1788201174.710079:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788201174.710104:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788201174.710114:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.710125:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201174.710137:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201174.710140:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0889be000 from 39 10000000:01000000:2.0:1788201174.710143:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201174.710178:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.710186:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.710205:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201174.710226:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184000:0@lo:101: 00000100:00100000:2.0:1788201174.710276:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.710347:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201174.710384:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681184000 00000100:00100000:3.0:1788201174.710390:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681184000 00000100:00100000:3.0:1788201174.710460:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788201174.710469:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681184000:12345-0@lo:101: 00010000:00010000:3.0:1788201174.710480:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201174.710496:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447201ce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.710534:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447201ce expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.710546:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447201ce expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.710555:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1c00, rc 0) 00000100:00100000:3.0:1788201174.710594:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681184000:12345-0@lo:101: Request processed in 126us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.710600:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788201174.710634:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184000:0@lo:101: 00010000:00010000:3.0:1788201174.710648:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.710656:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201174.710709:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184128:0@lo:501: 00000100:00100000:3.0:1788201174.710735:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.711186:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201174.711214:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681184128 00000100:00100000:2.0:1788201174.711219:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681184128 00000100:00100000:2.0:1788201174.711244:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201174.711251:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681184128:12345-0@lo:501: 00000100:00100000:2.0:1788201174.711381:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681184128:12345-0@lo:501: Request processed in 129us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.711387:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788201174.711453:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184128:0@lo:501: 00000004:00080000:1.0:1788201174.711462:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788201174.711484:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184256:0@lo:503: 00000100:00100000:3.0:1788201174.711526:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.711539:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201174.711548:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681184256 00000100:00100000:3.0:1788201174.711551:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681184256 00000100:00100000:3.0:1788201174.711575:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788201174.711580:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681184256:12345-0@lo:503: 00000100:00100000:3.0:1788201174.711651:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681184256:12345-0@lo:503: Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.711657:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788201174.711694:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184256:0@lo:503: 00000100:00100000:0.0:1788201174.713434:0:9975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9975:1875064681184384:0@lo:502: 00000100:00100000:0.0:1788201174.713506:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.713570:0:9975:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba1103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201174.713607:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681184384 00000100:00100000:3.0:1788201174.713614:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681184384 00000100:00100000:3.0:1788201174.713691:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788201174.713702:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:9975:x1875064681184384:12345-0@lo:502: 00000100:00100000:3.0:1788201174.714015:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:9975:x1875064681184384:12345-0@lo:502: Request processed in 315us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.714022:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788201174.714031:0:9975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9975:1875064681184384:0@lo:502: 00000100:00100000:1.0:1788201174.714082:0:9975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9975:1875064681184512:0@lo:502: 00000100:00100000:1.0:1788201174.714119:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.714146:0:9975:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.714228:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681184512 00000100:00100000:0.0:1788201174.714233:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681184512 00000100:00100000:0.0:1788201174.714253:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788201174.714259:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:9975:x1875064681184512:12345-0@lo:502: 00000100:00100000:0.0:1788201174.714351:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:9975:x1875064681184512:12345-0@lo:502: Request processed in 91us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.714358:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 40000000:02000000:0.0:1788201174.715168:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788201174.717504:0:9975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9975:1875064681184512:0@lo:502: 00000040:00080000:1.0:1788201174.717564:0:9975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788201174.717659:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788201174.717687:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201174.717701:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.717713:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201174.717723:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201174.717726:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0889be000 from 6 10000000:01000000:3.0:1788201174.717729:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201174.718000:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.718011:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.718056:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201174.718097:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184640:0@lo:101: 00000100:00100000:3.0:1788201174.718226:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.718296:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.719589:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681184640 00000100:00100000:1.0:1788201174.719601:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681184640 00000100:00100000:1.0:1788201174.719660:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788201174.719685:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681184640:12345-0@lo:101: 00010000:00010000:1.0:1788201174.719705:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201174.719725:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081671000/0xf9b71aee447201e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447201dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.719768:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081671000/0xf9b71aee447201e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447201dc expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.719781:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081671000/0xf9b71aee447201e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447201dc expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.719791:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081671000, rc 0) 00000100:00100000:1.0:1788201174.719861:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681184640:12345-0@lo:101: Request processed in 178us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.719867:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788201174.719943:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184640:0@lo:101: 00010000:00010000:1.0:1788201174.719962:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.719983:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201174.720048:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184768:0@lo:256: 00000100:00100000:1.0:1788201174.720087:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.720107:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.720122:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681184768 00000100:00100000:1.0:1788201174.720126:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681184768 00000100:00100000:1.0:1788201174.720151:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788201174.720158:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681184768:12345-0@lo:256: 20000000:01000000:1.0:1788201174.720173:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201174.720191:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201174.720194:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788201174.720279:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681184768:12345-0@lo:256: Request processed in 122us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.720286:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788201174.720288:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184768:0@lo:256: 10000000:01000000:3.0:1788201174.720337:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201174.720343:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.720352:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201174.720361:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788201174.720364:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788201174.720366:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201174.720386:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.720393:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201174.720402:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201174.720414:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184896:0@lo:101: 00000100:00100000:3.0:1788201174.720441:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.720470:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.720733:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681184896 00000100:00100000:1.0:1788201174.720764:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681184896 00000100:00100000:1.0:1788201174.720799:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788201174.720805:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681184896:12345-0@lo:101: 00010000:00010000:1.0:1788201174.720813:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201174.720824:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447201ea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.720840:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447201ea expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.720861:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447201ea expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.720869:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce081670400, rc 0) 00000100:00100000:1.0:1788201174.720914:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681184896:12345-0@lo:101: Request processed in 109us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.720920:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788201174.720954:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681184896:0@lo:101: 00010000:00010000:1.0:1788201174.720965:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.720974:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201174.721033:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681185024:0@lo:501: 00000100:00100000:1.0:1788201174.721059:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.721083:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba266e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.721095:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681185024 00000100:00100000:1.0:1788201174.721098:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681185024 00000100:00100000:1.0:1788201174.721126:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788201174.721132:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681185024:12345-0@lo:501: 00000100:00100000:1.0:1788201174.722556:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681185024:12345-0@lo:501: Request processed in 1417us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.722568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788201174.722811:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681185024:0@lo:501: 00000100:00100000:3.0:1788201174.722931:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681185152:0@lo:503: 00000100:00100000:3.0:1788201174.722989:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.723021:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201174.723099:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681185152 00000100:00100000:2.0:1788201174.723105:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681185152 00000100:00100000:2.0:1788201174.723151:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788201174.723161:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681185152:12345-0@lo:503: 00000100:00100000:2.0:1788201174.723274:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681185152:12345-0@lo:503: Request processed in 115us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.723281:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788201174.723358:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681185152:0@lo:503: 00000100:00100000:3.0:1788201174.723688:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9977:1875064681185280:0@lo:502: 00000100:00100000:3.0:1788201174.723722:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.723836:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.726832:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1875064681183872:12345-0@lo:700: Request processed in 17977us (19102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.726848:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201174.728022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681185280 00000100:00100000:2.0:1788201174.728037:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681185280 00000100:00100000:2.0:1788201174.728098:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788201174.728108:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:9977:x1875064681185280:12345-0@lo:502: 00000100:00100000:2.0:1788201174.728316:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:9977:x1875064681185280:12345-0@lo:502: Request processed in 209us (4592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.728333:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00080000:3.0:1788201174.729974:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333f800 x1875064681183872/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.729994:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1875064681183872:0@lo:700: 40000000:02000000:3.0:1788201174.730009:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1788201174.730588:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9977:1875064681185280:0@lo:502: 00000020:01000000:2.0:1788201174.730632:0:9977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201174.730641:0:9977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788201174.730650:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201174.730653:0:9977:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788201174.730658:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201174.730662:0:9977:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:2.0:1788201174.730691:0:9977:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201174.730694:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201174.730713:0:9977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ce0b9700000) 00000020:00000080:2.0:1788201174.731275:0:9977:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788201174.731288:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201174.731429:0:9977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788201174.731437:0:9977:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788201174.731445:0:9977:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee447201ff 00010000:00080000:2.0:1788201174.731499:0:9977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0a64be000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1788201174.731980:0:9977:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788201174.732247:0:9977:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788201174.732264:0:9977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788201174.732471:0:9977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201174.732601:0:9977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201174.732778:0:9977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788201174.732956:0:9977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788201174.735089:0:9980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788201174.735097:0:9980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788201174.736108:0:9977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201174.736124:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201174.736170:0:9977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788201174.736327:0:9977:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44720206 00000100:00080000:0.0:1788201174.736340:0:9977:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201174.736348:0:9977:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce0a64be000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201174.736394:0:9977:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c88700 x1875064681185408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201174.736420:0:9977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788201174.736488:0:9977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201174.736492:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201174.736495:0:9977:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788201174.736498:0:9977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201174.736502:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201174.736503:0:9977:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201174.736506:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201174.736509:0:9977:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788201174.736542:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9977:1875064681185536:0@lo:502: 00000100:00100000:0.0:1788201174.736637:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201174.736804:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.737831:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681185536 00000100:00100000:0.0:1788201174.737844:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681185536 00000100:00100000:0.0:1788201174.737920:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788201174.737931:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:9977:x1875064681185536:12345-0@lo:502: 00000100:00100000:0.0:1788201174.738130:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:9977:x1875064681185536:12345-0@lo:502: Request processed in 199us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.738139:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788201174.738311:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:9977:1875064681185536:0@lo:502: 00000020:01000000:1.0:1788201174.738382:0:9977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201174.738407:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201174.738409:0:9977:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788201174.738414:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:0.0:1788201174.738953:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681185408:0@lo:8: 00000100:00100000:0.0:1788201174.739007:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.739966:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681185408 00000100:00100000:1.0:1788201174.739978:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681185408 00000100:00100000:1.0:1788201174.740063:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201174.740074:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875064681185408:12345-0@lo:8: 00010000:00080000:1.0:1788201174.740124:0:8430:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1788201174.740200:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee4472020d 00002000:00100000:1.0:1788201174.740220:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cdf831fe800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788201174.740225:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788201174.740228:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201174.740322:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201174.740354:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9cdf831fc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201174.740442:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681185408:12345-0@lo:8: Request processed in 368us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.740450:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788201174.740518:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c88700 x1875064681185408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201174.740530:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201174.740540:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788201174.740548:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000020:01000000:2.0:1788201174.740556:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 00000100:00080000:0.0:1788201174.740556:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788201174.740558:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a64be000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788201174.740578:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788201174.740584:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681185408:0@lo:8: 10000000:01000000:2.0:1788201174.740586:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788201174.740598:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201174.740615:0:9980:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1788201174.740630:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201174.740640:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788201174.740643:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ce0b2520000 from 1 10000000:01000000:2.0:1788201174.740646:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201174.740679:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.740687:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.740697:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201174.740710:0:9980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 255037970437ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788201174.740716:0:9980:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788201174.740718:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681185664:0@lo:101: 00000100:00100000:2.0:1788201174.740859:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.740900:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201174.740929:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681185664 00000100:00100000:2.0:1788201174.740935:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681185664 00000100:00100000:2.0:1788201174.741011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788201174.741019:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681185664:12345-0@lo:101: 00010000:00010000:2.0:1788201174.741030:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201174.741063:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.741093:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720214 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.741115:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720214 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.741126:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1600, rc 0) 00000100:00100000:2.0:1788201174.741158:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681185664:12345-0@lo:101: Request processed in 140us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.741164:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788201174.741251:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681185664:0@lo:101: 00010000:00010000:2.0:1788201174.741268:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201174.741278:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201174.741331:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681185792:0@lo:501: 00000100:00100000:2.0:1788201174.741355:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.741406:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854cb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.742602:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681185792 00000100:00100000:1.0:1788201174.742614:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681185792 00000100:00100000:1.0:1788201174.742669:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788201174.742678:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681185792:12345-0@lo:501: 00000100:00100000:1.0:1788201174.742808:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681185792:12345-0@lo:501: Request processed in 131us (1452us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201174.742815:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788201174.742864:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681185792:0@lo:501: 10000000:01000000:1.0:1788201174.742914:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201174.742923:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201174.742939:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201174.746395:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788201174.746497:0:9981:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788201174.746529:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875064681186048:0@lo:7: 00000100:00100000:1.0:1788201174.746615:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.746659:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.746803:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681186048 00000100:00100000:0.0:1788201174.746813:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681186048 00000100:00100000:0.0:1788201174.746887:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201174.746899:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9981:x1875064681186048:12345-0@lo:7: 00000100:00100000:3.0:1788201174.749770:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681185920:0@lo:13: 00000100:00100000:3.0:1788201174.749870:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201174.749958:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201174.749974:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681185920 00000100:00100000:2.0:1788201174.749985:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681185920 00000100:00100000:2.0:1788201174.750038:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201174.750048:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681185920:12345-0@lo:13: 00002000:00000024:2.0:1788201174.750084:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923845120 avail 3692322816 00000100:00100000:2.0:1788201174.750139:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681185920:12345-0@lo:13: Request processed in 92us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.750146:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788201174.750195:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c9f80 x1875064681185920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.750226:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681185920:0@lo:13: 00000001:00100000:2.0:1788201174.752852:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788201174.752883:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788201174.753117:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9972:x1875064681183744:12345-0@lo:700: Request processed in 45453us (45538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.753130:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788201174.753211:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333e300 x1875064681183744/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201174.753227:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1875064681183744:0@lo:700: 00002000:00080000:0.0:1788201174.753458:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788201174.753468:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788201174.753556:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9981:x1875064681186048:12345-0@lo:7: Request processed in 6659us (6940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.753564:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788201174.753620:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834cad80 x1875064681186048/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201174.753630:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875064681186048:0@lo:7: 00000004:00080000:1.0:1788201174.753640:0:9981:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788201174.753867:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875064681186176:0@lo:5: 00000100:00100000:1.0:1788201174.753914:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.753968:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.754001:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681186176 00000100:00100000:0.0:1788201174.754008:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681186176 00000100:00100000:0.0:1788201174.754082:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201174.754092:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9981:x1875064681186176:12345-0@lo:5: 00002000:00080000:0.0:1788201174.754123:0:8485:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788201174.754127:0:8485:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788201174.754443:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9981:x1875064681186176:12345-0@lo:5: Request processed in 351us (527us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788201174.754449:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788201174.754500:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834cad80 x1875064681186176/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201174.754513:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875064681186176:0@lo:5: 00000004:00080000:2.0:1788201174.754522:0:9981:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788201174.754546:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875064681186304:0@lo:700: 00000100:00100000:2.0:1788201174.754568:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.754583:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854cb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.754618:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681186304 00000100:00100000:1.0:1788201174.754622:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681186304 00000100:00100000:1.0:1788201174.754653:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201174.754659:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9981:x1875064681186304:12345-0@lo:700: 00000004:00080000:0.0:1788201174.762773:0:9972:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788201174.762777:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201174.762808:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681186432:0@lo:13: 00000100:00100000:0.0:1788201174.762808:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1875064681186560:0@lo:7: 00000100:00100000:1.0:1788201174.767432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.767534:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681186432 00000100:00100000:1.0:1788201174.767546:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681186432 00000100:00100000:1.0:1788201174.767606:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201174.767618:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681186432:12345-0@lo:13: 00002000:00000024:1.0:1788201174.767651:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923845120 avail 3692322816 00000100:00100000:1.0:1788201174.767723:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681186432:12345-0@lo:13: Request processed in 107us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.767731:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788201174.767832:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c88700 x1875064681186432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201174.767856:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681186432:0@lo:13: 00000100:00100000:2.0:1788201174.767914:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.767976:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201174.768061:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681186560 00000100:00100000:3.0:1788201174.768066:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681186560 00000100:00100000:3.0:1788201174.768101:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201174.768109:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9972:x1875064681186560:12345-0@lo:7: 00000001:00080000:2.0:1788201174.770379:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1788201174.772933:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9981:x1875064681186304:12345-0@lo:700: Request processed in 18264us (18353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.772951:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788201174.773119:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333e300 x1875064681186304/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201174.773132:0:9981:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788201174.773150:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875064681186304:0@lo:700: 00000004:02000040:0.0:1788201174.776303:0:9981:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:3.0:1788201174.777577:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788201174.777586:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788201174.777718:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9972:x1875064681186560:12345-0@lo:7: Request processed in 9602us (9797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.777730:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788201174.778469:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c8bb80 x1875064681186560/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201174.778487:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1875064681186560:0@lo:7: 00000004:00080000:2.0:1788201174.778505:0:9972:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788201174.778557:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1875064681186688:0@lo:5: 00000100:00100000:2.0:1788201174.778619:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.778675:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.778760:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681186688 00000100:00100000:1.0:1788201174.778769:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681186688 00000100:00100000:1.0:1788201174.778830:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201174.778840:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9972:x1875064681186688:12345-0@lo:5: 00002000:00080000:1.0:1788201174.778883:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788201174.779792:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9972:x1875064681186688:12345-0@lo:5: Request processed in 950us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.779800:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788201174.780583:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333ce00 x1875064681186688/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.780599:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1875064681186688:0@lo:5: 00000004:00080000:3.0:1788201174.780613:0:9972:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788201174.780658:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1875064681186816:0@lo:5: 00000100:00100000:3.0:1788201174.780703:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.780753:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.780761:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681186816 00000100:00100000:1.0:1788201174.780768:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681186816 00000100:00100000:1.0:1788201174.780811:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201174.780820:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9972:x1875064681186816:12345-0@lo:5: 00002000:00080000:1.0:1788201174.780856:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1788201174.783712:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9972:x1875064681186816:12345-0@lo:5: Request processed in 2884us (3000us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788201174.783725:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788201174.783735:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82604000 x1875064681186816/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201174.783774:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1875064681186816:0@lo:5: 00000004:00080000:3.0:1788201174.783790:0:9972:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788201174.783836:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9972:1875064681186944:0@lo:900: 00000100:00100000:3.0:1788201174.783887:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.783921:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201174.784066:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681186944 00000100:00100000:1.0:1788201174.784078:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681186944 00000100:00100000:1.0:1788201174.784122:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201174.784131:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9972:x1875064681186944:12345-0@lo:900: 00000100:00100000:1.0:1788201174.784221:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9972:x1875064681186944:12345-0@lo:900: Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201174.784228:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788201174.784280:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fc700 x1875064681186944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201174.784290:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9972:1875064681186944:0@lo:900: 00000100:00100000:2.0:1788201174.784353:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875064681187072:0@lo:5: 00000100:00100000:2.0:1788201174.784385:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.784409:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201174.784430:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681187072 00000100:00100000:0.0:1788201174.784435:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681187072 00000100:00100000:0.0:1788201174.784501:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201174.784510:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9981:x1875064681187072:12345-0@lo:5: 00002000:00080000:2.0:1788201174.791344:0:8485:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788201174.791374:0:8485:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788201174.793059:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9981:x1875064681187072:12345-0@lo:5: Request processed in 8541us (8664us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788201174.793073:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788201174.793167:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333f800 x1875064681187072/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201174.793188:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875064681187072:0@lo:5: 00000004:00080000:0.0:1788201174.793209:0:9981:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1788201175.222775:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788201175.802359:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1788201175.802382:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788201176.246330:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201176.694525:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201176.694562:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681187200:0@lo:41: 00000100:00100000:0.0:1788201176.695397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201176.696138:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681187328:0@lo:41: 00000100:00100000:0.0:1788201176.696188:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201176.697414:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681187200 00000100:00100000:3.0:1788201176.697427:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681187200 00000100:00100000:3.0:1788201176.697504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681187328 00000100:00100000:3.0:1788201176.697508:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681187328 00000100:00100000:3.0:1788201176.697529:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201176.697539:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681187200:12345-0@lo:41: 00000004:00000024:3.0:1788201176.697587:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788201176.699654:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681187200:0@lo:41: 00000100:00100000:1.0:1788201176.700260:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201176.700286:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681187328:12345-0@lo:41: 00000004:00000024:1.0:1788201176.700344:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788201176.700450:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681187200:12345-0@lo:41: Request processed in 2909us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201176.700476:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201176.708565:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681187328:12345-0@lo:41: Request processed in 8276us (12360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201176.708585:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201176.716183:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681187328:0@lo:41: 00000020:00000004:2.0:1788201176.862124:0:10036:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201176.863114:0:10036:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788201177.205896:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201177.205933:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681187456:0@lo:13: 00000100:00100000:2.0:1788201177.206018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201177.206087:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681187456 00000100:00100000:2.0:1788201177.206095:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681187456 00000100:00100000:2.0:1788201177.206151:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201177.206161:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681187456:12345-0@lo:13: 00002000:00000024:2.0:1788201177.206194:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201177.206237:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681187456:12345-0@lo:13: Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201177.206244:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788201177.206264:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201177.206297:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333d180 x1875064681187456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201177.206318:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681187456:0@lo:13: 00000100:00100000:0.0:1788201177.206426:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201177.206436:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681187584:0@lo:13: 00000100:00100000:0.0:1788201177.206466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201177.206502:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681187584 00000100:00100000:0.0:1788201177.206506:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681187584 00000100:00100000:0.0:1788201177.206535:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201177.206542:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681187584:12345-0@lo:13: 00002000:00000024:0.0:1788201177.206552:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201177.206583:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681187584:12345-0@lo:13: Request processed in 41us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201177.206588:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788201177.206875:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201177.206898:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c8b480 x1875064681187584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201177.206913:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681187584:0@lo:13: 00010000:00010000:0.0:1788201177.270103:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201177.894170:0:10084:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201177.894183:0:10084:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788201178.294777:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201178.453829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201178.455513:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662261888 00000100:00100000:1.0:1788201178.455530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662261888 00000100:00100000:1.0:1788201178.455601:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 180 00000100:00100000:1.0:1788201178.455611:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2397:x1875064662261888:12345-192.168.203.2@tcp:250: 00010000:00080000:1.0:1788201178.455656:0:6511:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 96646b6c-1f38-4253-ba71-8fb9a5b4735a@192.168.203.2@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:1.0:1788201178.455693:0:6511:0:(genops.c:1406:class_connect()) connect: client 96646b6c-1f38-4253-ba71-8fb9a5b4735a, cookie 0xf9b71aee44720222 00000100:00080000:1.0:1788201178.455885:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201178.455979:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+5:2397:x1875064662261888:12345-192.168.203.2@tcp:250: Request processed in 367us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201178.455987:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 180 00000100:00100000:3.0:1788201178.480067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201178.480238:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662262016 00000100:00100000:2.0:1788201178.480269:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662262016 00000100:00100000:2.0:1788201178.480404:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:2.0:1788201178.480417:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+5:6157:x1875064662262016:12345-192.168.203.2@tcp:101: 00010000:00010000:2.0:1788201178.480438:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201178.480478:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbeba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.480603:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.480629:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.481466:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1c00, rc 0) 00000100:00100000:2.0:1788201178.481813:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+6:6157:x1875064662262016:12345-192.168.203.2@tcp:101: Request processed in 1388us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201178.482059:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:2.0:1788201178.490241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201178.490531:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662262144 00000100:00100000:1.0:1788201178.490544:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662262144 00000100:00100000:1.0:1788201178.490804:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:1.0:1788201178.491167:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+6:6157:x1875064662262144:12345-192.168.203.2@tcp:501: 00000100:00100000:1.0:1788201178.492191:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+6:6157:x1875064662262144:12345-192.168.203.2@tcp:501: Request processed in 1024us (2004us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201178.492213:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:0.0:1788201178.513425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201178.513989:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662262272 00000100:00100000:2.0:1788201178.514005:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662262272 00000100:00100000:2.0:1788201178.514104:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:2.0:1788201178.514117:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+6:6157:x1875064662262272:12345-192.168.203.2@tcp:101: 00010000:00010000:2.0:1788201178.514142:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201178.514166:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbec1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.514203:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.514216:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.514245:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0800, rc 0) 00000100:00100000:2.0:1788201178.514327:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+7:6157:x1875064662262272:12345-192.168.203.2@tcp:101: Request processed in 212us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201178.514335:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:2.0:1788201178.520668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201178.520898:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662262400 00000100:00100000:1.0:1788201178.520913:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662262400 00000100:00100000:1.0:1788201178.521048:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:1.0:1788201178.521061:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+7:6157:x1875064662262400:12345-192.168.203.2@tcp:501: 00000100:00100000:1.0:1788201178.521527:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6157:x1875064662262400:12345-192.168.203.2@tcp:501: Request processed in 467us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201178.521544:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:3.0:1788201178.525393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201178.526167:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662262528 00000100:00100000:1.0:1788201178.526183:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662262528 00000100:00100000:1.0:1788201178.526323:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 185 00000100:00100000:1.0:1788201178.526338:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6157:x1875064662262528:12345-192.168.203.2@tcp:503: 00000100:00100000:1.0:1788201178.526552:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6157:x1875064662262528:12345-192.168.203.2@tcp:503: Request processed in 216us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201178.526561:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 185 00000100:00100000:0.0:1788201178.533345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201178.533484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662262656 00000100:00100000:2.0:1788201178.533496:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662262656 00000100:00100000:2.0:1788201178.533606:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:2.0:1788201178.533616:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6175:x1875064662262656:12345-192.168.203.2@tcp:502: 00000100:00100000:2.0:1788201178.533924:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6175:x1875064662262656:12345-192.168.203.2@tcp:502: Request processed in 308us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201178.533933:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:3.0:1788201178.548292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201178.549630:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662262784 00000100:00100000:1.0:1788201178.549648:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662262784 00000100:00100000:2.0:1788201178.550880:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 187 00000100:00100000:2.0:1788201178.550902:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6175:x1875064662262784:12345-192.168.203.2@tcp:502: 00000100:00100000:2.0:1788201178.551441:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6175:x1875064662262784:12345-192.168.203.2@tcp:502: Request processed in 545us (3160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201178.551451:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 187 00000100:00100000:0.0:1788201178.555132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201178.555248:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662262912 00000100:00100000:2.0:1788201178.555261:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662262912 00000100:00100000:2.0:1788201178.555331:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 188 00000100:00100000:2.0:1788201178.555343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6157:x1875064662262912:12345-192.168.203.2@tcp:101: 00010000:00010000:2.0:1788201178.555365:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201178.555387:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1000/0xf9b71aee44720237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbef2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.555445:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1000/0xf9b71aee44720237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef2 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.555459:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1000/0xf9b71aee44720237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef2 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.555471:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1000, rc 0) 00000100:00100000:2.0:1788201178.555836:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6157:x1875064662262912:12345-192.168.203.2@tcp:101: Request processed in 494us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201178.555854:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 188 00000100:00100000:0.0:1788201178.583333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201178.583729:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662263040 00000100:00100000:2.0:1788201178.583794:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662263040 00000100:00100000:2.0:1788201178.583881:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 189 00000100:00100000:2.0:1788201178.583894:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6157:x1875064662263040:12345-192.168.203.2@tcp:256: 20000000:01000000:2.0:1788201178.583936:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788201178.583976:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201178.583983:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201178.583986:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201178.583989:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788201178.583992:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788201178.592332:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6157:x1875064662263040:12345-192.168.203.2@tcp:256: Request processed in 8414us (9000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201178.592350:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 189 00000100:00100000:0.0:1788201178.614535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201178.619122:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662263168 00000100:00100000:2.0:1788201178.619144:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662263168 00000100:00100000:2.0:1788201178.619243:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 190 00000100:00100000:2.0:1788201178.619255:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6157:x1875064662263168:12345-192.168.203.2@tcp:101: 00010000:00010000:2.0:1788201178.619278:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201178.619301:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbef9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.619360:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.619374:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201178.619384:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1e00, rc 0) 00000100:00100000:2.0:1788201178.619474:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6157:x1875064662263168:12345-192.168.203.2@tcp:101: Request processed in 222us (4966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201178.619482:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 190 00000100:00100000:2.0:1788201178.627782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201178.627899:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662263296 00000100:00100000:0.0:1788201178.627909:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662263296 00000100:00100000:0.0:1788201178.628004:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:0.0:1788201178.628015:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6157:x1875064662263296:12345-192.168.203.2@tcp:501: 00000100:00100000:0.0:1788201178.628198:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6157:x1875064662263296:12345-192.168.203.2@tcp:501: Request processed in 184us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201178.628206:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:3.0:1788201178.639336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201178.639441:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662263424 00000100:00100000:1.0:1788201178.639450:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662263424 00000100:00100000:1.0:1788201178.639517:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:1.0:1788201178.639527:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6157:x1875064662263424:12345-192.168.203.2@tcp:503: 00000100:00100000:1.0:1788201178.639690:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6157:x1875064662263424:12345-192.168.203.2@tcp:503: Request processed in 164us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201178.639708:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:1.0:1788201178.654449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201178.655603:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662263552 00000100:00100000:0.0:1788201178.655616:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662263552 00000100:00100000:0.0:1788201178.655689:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:0.0:1788201178.655701:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6182:x1875064662263552:12345-192.168.203.2@tcp:502: 00000100:00100000:0.0:1788201178.655919:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6182:x1875064662263552:12345-192.168.203.2@tcp:502: Request processed in 220us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201178.655928:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:0.0:1788201178.664808:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201178.665282:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662263680 00000100:00100000:2.0:1788201178.665293:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662263680 00000100:00100000:2.0:1788201178.665390:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:2.0:1788201178.665401:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6182:x1875064662263680:12345-192.168.203.2@tcp:502: 00000100:00100000:2.0:1788201178.665583:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6182:x1875064662263680:12345-192.168.203.2@tcp:502: Request processed in 177us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201178.665592:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:3.0:1788201178.679300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201178.679358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201178.679457:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662263808 00000100:00100000:1.0:1788201178.679482:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662263808 00000100:00100000:1.0:1788201178.679529:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662264064 00000100:00100000:1.0:1788201178.679533:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662264064 00000100:00100000:1.0:1788201178.679576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1788201178.679585:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1875064662263808:12345-192.168.203.2@tcp:38: 00010000:00080000:1.0:1788201178.679615:0:6517:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:1.0:1788201178.679672:0:6517:0:(genops.c:1406:class_connect()) connect: client da566c69-17bd-4938-bc1e-8b9ba2633293, cookie 0xf9b71aee44720245 00000004:00100000:1.0:1788201178.679698:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788201178.679945:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:0.0:1788201178.679952:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875064662264064:12345-192.168.203.2@tcp:38: 00010000:00080000:0.0:1788201178.679969:0:6515:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp t0 exp 0000000000000000 cur 258 last 0 00000100:00080000:1.0:1788201178.679973:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf446000 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1788201178.680004:0:6515:0:(genops.c:1406:class_connect()) connect: client da566c69-17bd-4938-bc1e-8b9ba2633293, cookie 0xf9b71aee4472024c 00000004:00100000:0.0:1788201178.680016:0:6515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788201178.680061:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2397:x1875064662263808:12345-192.168.203.2@tcp:38: Request processed in 475us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201178.680069:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00080000:0.0:1788201178.680147:0:6515:0:(import.c:65:import_set_state_nolock()) ffff9ce0bbbd9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201178.680173:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2397:x1875064662264064:12345-192.168.203.2@tcp:38: Request processed in 220us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201178.680179:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00010000:00010000:0.0:1788201179.318392:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201179.700656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201179.700695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201179.700806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201179.700894:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662263936 00000100:00100000:2.0:1788201179.700904:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662263936 00000100:00100000:2.0:1788201179.700973:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662264320 00000100:00100000:2.0:1788201179.700977:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662264320 00000100:00100000:2.0:1788201179.700987:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662264192 00000100:00100000:2.0:1788201179.700989:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662264192 00000100:00100000:2.0:1788201179.701008:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1788201179.701017:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:0:x1875064662263936:12345-192.168.203.2@tcp:41: 00000004:00000024:2.0:1788201179.701066:0:8476:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788201179.701109:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:3.0:1788201179.701118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:6157:x1875064662264320:12345-192.168.203.2@tcp:41: 00000004:00000024:3.0:1788201179.701132:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788201179.701145:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:0:x1875064662263936:12345-192.168.203.2@tcp:41: Request processed in 128us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201179.701152:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:6157:x1875064662264320:12345-192.168.203.2@tcp:41: Request processed in 37us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.701152:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1788201179.701158:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1788201179.701171:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:2.0:1788201179.701178:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:0:x1875064662264192:12345-192.168.203.2@tcp:41: 00000004:00000024:2.0:1788201179.701194:0:8476:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201179.701215:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:0:x1875064662264192:12345-192.168.203.2@tcp:41: Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.701221:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00080000:0.0:1788201179.701493:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201179.701497:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201179.703850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201179.703951:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662264448 00000100:00100000:3.0:1788201179.703962:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662264448 00000100:00100000:3.0:1788201179.704030:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1788201179.704041:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6157:x1875064662264448:12345-192.168.203.2@tcp:40: 00000100:00100000:3.0:1788201179.704133:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6157:x1875064662264448:12345-192.168.203.2@tcp:40: Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201179.704141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1788201179.706286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201179.706364:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662264832 00000100:00100000:1.0:1788201179.706373:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662264832 00000100:00100000:1.0:1788201179.706439:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1788201179.706450:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6157:x1875064662264832:12345-192.168.203.2@tcp:900: 00000100:00100000:1.0:1788201179.706534:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6157:x1875064662264832:12345-192.168.203.2@tcp:900: Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.706541:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1788201179.706799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201179.706892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201179.706964:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662264576 00000100:00100000:2.0:1788201179.706970:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662264576 00000100:00100000:2.0:1788201179.707001:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662264704 00000100:00100000:2.0:1788201179.707005:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662264704 00000100:00100000:2.0:1788201179.707030:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1788201179.707036:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875064662264576:12345-192.168.203.2@tcp:8: 00010000:00080000:2.0:1788201179.707065:0:8432:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp t0 exp 0000000000000000 cur 260 last 0 00000100:00100000:3.0:1788201179.707090:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000020:00000080:2.0:1788201179.707095:0:8432:0:(genops.c:1406:class_connect()) connect: client da566c69-17bd-4938-bc1e-8b9ba2633293, cookie 0xf9b71aee44720253 00000100:00100000:3.0:1788201179.707096:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875064662264704:12345-192.168.203.2@tcp:8: 00002000:00100000:2.0:1788201179.707105:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da566c69-17bd-4938-bc1e-8b9ba2633293/ffff9ce0a64b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:3.0:1788201179.707111:0:8431:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp t0 exp 0000000000000000 cur 260 last 0 00002000:00100000:2.0:1788201179.707123:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1788201179.707142:0:8431:0:(genops.c:1406:class_connect()) connect: client da566c69-17bd-4938-bc1e-8b9ba2633293, cookie 0xf9b71aee4472025a 00002000:00100000:3.0:1788201179.707147:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli da566c69-17bd-4938-bc1e-8b9ba2633293/ffff9ce0bf458800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201179.707159:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788201179.707412:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788201179.707442:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ce0a64b8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201179.707492:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2397:x1875064662264576:12345-192.168.203.2@tcp:8: Request processed in 454us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.707499:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00002000:00080000:3.0:1788201179.710867:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201179.710918:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201179.710989:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2397:x1875064662264704:12345-192.168.203.2@tcp:8: Request processed in 3888us (4095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201179.711000:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1788201179.711189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201179.711505:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662264960 00000100:00100000:2.0:1788201179.711513:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662264960 00000100:00100000:2.0:1788201179.711575:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 195 00000100:00100000:2.0:1788201179.711583:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2400:x1875064662264960:12345-192.168.203.2@tcp:400: 00000100:00100000:2.0:1788201179.711622:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2400:x1875064662264960:12345-192.168.203.2@tcp:400: Request processed in 40us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.711629:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 195 00000100:00100000:0.0:1788201179.717149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201179.717256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662265088 00000100:00100000:3.0:1788201179.717266:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662265088 00000100:00100000:3.0:1788201179.717325:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1788201179.717336:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6157:x1875064662265088:12345-192.168.203.2@tcp:33: 00000100:00100000:1.0:1788201179.768007:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681187712:0@lo:400: 00000100:00100000:1.0:1788201179.768091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768143:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681188224:0@lo:400: 00000100:00100000:1.0:1788201179.768169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768185:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681188736:0@lo:400: 00000100:00100000:1.0:1788201179.768207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768226:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681189248:0@lo:400: 00000100:00100000:1.0:1788201179.768246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768268:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201179.768274:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681187840:0@lo:400: 00000100:00100000:1.0:1788201179.768299:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768317:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681188352:0@lo:400: 00000100:00100000:1.0:1788201179.768337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768356:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681188864:0@lo:400: 00000100:00100000:1.0:1788201179.768380:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768410:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681188096:0@lo:400: 00000100:00100000:1.0:1788201179.768478:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768494:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681188608:0@lo:400: 00000100:00100000:1.0:1788201179.768512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768526:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681189120:0@lo:400: 00000100:00100000:1.0:1788201179.768555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768571:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788201179.768575:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681187968:0@lo:400: 00000100:00100000:1.0:1788201179.768595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768611:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681188480:0@lo:400: 00000100:00100000:1.0:1788201179.768630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768649:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681188992:0@lo:400: 00000100:00100000:1.0:1788201179.768673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.768698:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681188736 00000100:00100000:1.0:1788201179.768704:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681188736 00000100:00100000:1.0:1788201179.768768:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681189248 00000100:00100000:1.0:1788201179.768771:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681189248 00000100:00100000:1.0:1788201179.768802:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681188608 00000100:00100000:1.0:1788201179.768805:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681188608 00000100:00100000:1.0:1788201179.768817:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681189120 00000100:00100000:1.0:1788201179.768819:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681189120 00000100:00100000:1.0:1788201179.768834:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201179.768856:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681188736:12345-0@lo:400: 00000100:00100000:1.0:1788201179.768909:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681188736:12345-0@lo:400: Request processed in 55us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.768916:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201179.768933:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201179.768939:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681189248:12345-0@lo:400: 00000100:00100000:1.0:1788201179.768966:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681189248:12345-0@lo:400: Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.768974:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201179.768984:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201179.768989:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681188608:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769019:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681188608:12345-0@lo:400: Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769025:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201179.769034:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201179.769040:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681189120:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769065:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681189120:12345-0@lo:400: Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769077:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201179.769096:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681187840 00000100:00100000:1.0:1788201179.769100:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681187840 00000100:00100000:1.0:1788201179.769116:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681188352 00000100:00100000:1.0:1788201179.769118:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681188352 00000100:00100000:1.0:1788201179.769131:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681188864 00000100:00100000:1.0:1788201179.769133:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681188864 00000100:00100000:1.0:1788201179.769141:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681188096 00000100:00100000:1.0:1788201179.769143:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681188096 00000100:00100000:1.0:1788201179.769151:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681188480 00000100:00100000:1.0:1788201179.769153:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681188480 00000100:00100000:1.0:1788201179.769163:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681188992 00000100:00100000:1.0:1788201179.769165:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681188992 00000100:00100000:1.0:1788201179.769177:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201179.769182:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681187840:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769211:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681187840:12345-0@lo:400: Request processed in 29us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769216:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201179.769226:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201179.769231:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681188352:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769272:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681188352:12345-0@lo:400: Request processed in 41us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769278:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201179.769290:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201179.769296:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681188864:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769321:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681188864:12345-0@lo:400: Request processed in 26us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769327:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201179.769346:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201179.769352:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681188096:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769380:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681188096:12345-0@lo:400: Request processed in 29us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769385:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201179.769395:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201179.769401:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681188480:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769425:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681188480:12345-0@lo:400: Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769431:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201179.769441:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201179.769448:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681188992:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769473:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681188992:12345-0@lo:400: Request processed in 26us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769478:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201179.769512:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681188224 00000100:00100000:1.0:1788201179.769516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681188224 00000100:00100000:1.0:1788201179.769542:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681187968 00000100:00100000:1.0:1788201179.769546:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681187968 00000100:00100000:1.0:1788201179.769558:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201179.769564:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681188224:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769595:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681188224:12345-0@lo:400: Request processed in 31us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769601:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201179.769611:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201179.769617:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681187968:12345-0@lo:400: 00000100:00100000:1.0:1788201179.769644:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681187968:12345-0@lo:400: Request processed in 27us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.769656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201179.769696:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681187968:0@lo:400: 00010000:00080000:1.0:1788201179.769712:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12dc00 x1875064681188480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769723:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681188480:0@lo:400: 00010000:00080000:1.0:1788201179.769734:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba2f1f80 x1875064681188992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769766:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681188992:0@lo:400: 00010000:00080000:1.0:1788201179.769780:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12f800 x1875064681188096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769788:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681188096:0@lo:400: 00010000:00080000:1.0:1788201179.769799:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12fb80 x1875064681188608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769807:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681188608:0@lo:400: 00010000:00080000:1.0:1788201179.769818:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba2f2680 x1875064681189120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769824:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788201179.769852:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681189120:0@lo:400: 00010000:00080000:1.0:1788201179.769894:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12df80 x1875064681187840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769902:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681187840:0@lo:400: 00010000:00080000:1.0:1788201179.769914:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12f100 x1875064681188352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769929:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681188352:0@lo:400: 00010000:00080000:1.0:1788201179.769943:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba2f1880 x1875064681188864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769951:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681188864:0@lo:400: 00000100:00100000:1.0:1788201179.769962:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681188224:0@lo:400: 00010000:00080000:1.0:1788201179.769973:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12ce00 x1875064681188736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769980:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681188736:0@lo:400: 00010000:00080000:1.0:1788201179.769991:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba2f1180 x1875064681189248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201179.769998:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788201179.770009:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681189248:0@lo:400: 00000100:00080000:0.0:1788201179.770139:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201179.770144:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201179.770148:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201179.770151:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201179.770188:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681187712 00000100:00100000:0.0:1788201179.770193:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681187712 00000100:00100000:0.0:1788201179.770234:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788201179.770241:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681187712:12345-0@lo:400: 00000100:00100000:0.0:1788201179.770283:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681187712:12345-0@lo:400: Request processed in 43us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201179.770298:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788201179.770332:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681187712:0@lo:400: 00000004:00080000:3.0:1788201179.771823:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 54396us 00000100:00100000:3.0:1788201179.772135:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201179.772152:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681189376:0@lo:13: 00000100:00100000:3.0:1788201179.772218:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201179.787171:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681189376 00000100:00100000:0.0:1788201179.787183:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681189376 00000100:00100000:0.0:1788201179.787247:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201179.787258:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681189376:12345-0@lo:13: 00002000:00000024:0.0:1788201179.787284:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201179.787362:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681189376:12345-0@lo:13: Request processed in 106us (15144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201179.787369:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788201179.788281:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c88000 x1875064681189376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201179.788304:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681189376:0@lo:13: 00000004:00200000:3.0:1788201179.806770:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788201179.806893:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6157:x1875064662265088:12345-192.168.203.2@tcp:33: Request processed in 89553us (89749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201179.806904:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:1.0:1788201180.030150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201180.033163:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662265216 00000100:00100000:2.0:1788201180.033180:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662265216 00000100:00100000:2.0:1788201180.033270:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:2.0:1788201180.033281:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6200:x1875064662265216:12345-192.168.203.2@tcp:101: 00010000:00010000:2.0:1788201180.033301:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201180.035819:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbf2a expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201180.035923:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720268 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201180.035936:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201180.035952:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201180.036004:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201180.036008:0:8476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201180.036023:0:8476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201180.036052:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf2a expref: 8 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201180.037575:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720268 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf2a expref: 7 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201180.037590:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0a1883d00) 00010000:00010000:2.0:1788201180.037594:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201180.037598:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0c00, rc 0) 00000100:00100000:2.0:1788201180.037669:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:6200:x1875064662265216:12345-192.168.203.2@tcp:101: Request processed in 4390us (7534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201180.037679:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:1.0:1788201180.278208:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201180.278262:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681189504:0@lo:13: 00000100:00100000:1.0:1788201180.278376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201180.279463:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681189504 00000100:00100000:0.0:1788201180.279476:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681189504 00000100:00100000:0.0:1788201180.279543:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201180.279554:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681189504:12345-0@lo:13: 00002000:00000024:0.0:1788201180.279581:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201180.279680:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681189504:12345-0@lo:13: Request processed in 128us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201180.279687:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788201180.279910:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c8a680 x1875064681189504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201180.279931:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681189504:0@lo:13: 00010000:00010000:0.0:1788201180.345226:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201181.366218:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201181.814023:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201181.814060:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681189632:0@lo:41: 00000100:00100000:2.0:1788201181.814163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201181.814282:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201181.814309:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681189760:0@lo:41: 00000100:00100000:1.0:1788201181.814509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201181.814820:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681189632 00000100:00100000:2.0:1788201181.814835:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681189760 00000100:00100000:2.0:1788201181.814847:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681189760 00000100:00100000:2.0:1788201181.814922:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201181.814935:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681189760:12345-0@lo:41: 00000004:00000024:2.0:1788201181.814982:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788201181.815044:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681189760:12345-0@lo:41: Request processed in 111us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201181.815052:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201181.815106:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681189632 00000100:00100000:0.0:1788201181.815143:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201181.815151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681189632:12345-0@lo:41: 00000004:00000024:0.0:1788201181.815173:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788201181.815214:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681189632:12345-0@lo:41: Request processed in 64us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201181.815236:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201181.815292:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681189632:0@lo:41: 00000100:00100000:1.0:1788201181.815296:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681189760:0@lo:41: 00000100:00100000:0.0:1788201182.327160:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681190016:0@lo:13: 00000100:00100000:0.0:1788201182.327252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201182.327492:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681190016 00000100:00100000:2.0:1788201182.327502:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681190016 00000100:00100000:2.0:1788201182.327572:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201182.327584:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681190016:12345-0@lo:13: 00002000:00000024:2.0:1788201182.327629:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201182.327684:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681190016:12345-0@lo:13: Request processed in 103us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201182.327708:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788201182.327774:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333d500 x1875064681190016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201182.327794:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681190016:0@lo:13: 00000100:00080000:0.0:1788201182.327907:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201182.328683:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681189888:0@lo:13: 00000100:00100000:1.0:1788201182.328770:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201182.329065:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681189888 00000100:00100000:2.0:1788201182.329074:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681189888 00000100:00100000:2.0:1788201182.329128:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201182.329137:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681189888:12345-0@lo:13: 00002000:00000024:2.0:1788201182.329158:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201182.329204:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681189888:12345-0@lo:13: Request processed in 68us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201182.329211:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788201182.329266:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201182.330815:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c8a300 x1875064681189888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201182.330854:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681189888:0@lo:13: 00010000:00010000:0.0:1788201182.390022:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201182.435384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201182.435699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662265344 00000100:00100000:3.0:1788201182.435712:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662265344 00000100:00100000:3.0:1788201182.435850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:3.0:1788201182.435864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:6252:x1875064662265344:12345-192.168.203.2@tcp:41: 00000004:00000024:3.0:1788201182.435955:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788201182.436040:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:6252:x1875064662265344:12345-192.168.203.2@tcp:41: Request processed in 180us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201182.436048:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00080000:0.0:1788201182.436148:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201182.442547:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201182.442683:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662265472 00000100:00100000:1.0:1788201182.442697:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662265472 00000100:00100000:1.0:1788201182.442865:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:1.0:1788201182.442879:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6252:x1875064662265472:12345-192.168.203.2@tcp:41: 00000004:00000024:1.0:1788201182.442921:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201182.443029:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6252:x1875064662265472:12345-192.168.203.2@tcp:41: Request processed in 153us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201182.443037:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:2.0:1788201182.447964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1788201182.448011:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201182.450475:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662265600 00000100:00100000:3.0:1788201182.450488:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662265600 00000100:00100000:3.0:1788201182.450587:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201182.450598:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6252:x1875064662265600:12345-192.168.203.2@tcp:13: 00002000:00000024:3.0:1788201182.450632:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201182.450709:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6252:x1875064662265600:12345-192.168.203.2@tcp:13: Request processed in 113us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201182.450716:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00080000:0.0:1788201182.452191:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201182.454403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201182.454868:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662265728 00000100:00100000:2.0:1788201182.454878:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662265728 00000100:00100000:2.0:1788201182.454954:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:2.0:1788201182.454966:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6252:x1875064662265728:12345-192.168.203.2@tcp:13: 00002000:00000024:2.0:1788201182.455002:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788201182.455004:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201182.455077:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da566c69-17bd-4938-bc1e-8b9ba2633293+6:6252:x1875064662265728:12345-192.168.203.2@tcp:13: Request processed in 112us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201182.455086:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00010000:00010000:1.0:1788201183.413934:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201183.868015:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00010000:00010000:1.0:1788201184.439026:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201184.893397:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681190528:0@lo:400: 00000100:00100000:3.0:1788201184.893484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.893543:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681191040:0@lo:400: 00000100:00100000:3.0:1788201184.893568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.893611:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681191552:0@lo:400: 00000100:00100000:3.0:1788201184.893632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.893829:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788201184.893836:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681190144:0@lo:400: 00000100:00100000:3.0:1788201184.893866:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.893889:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681190656:0@lo:400: 00000100:00100000:3.0:1788201184.893922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.893939:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681191168:0@lo:400: 00000100:00100000:3.0:1788201184.893958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.893976:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681191680:0@lo:400: 00000100:00100000:3.0:1788201184.893996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.894024:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681190272:0@lo:400: 00000100:00100000:3.0:1788201184.894045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.894060:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681190784:0@lo:400: 00000100:00100000:3.0:1788201184.894078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.894092:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681191296:0@lo:400: 00000100:00100000:3.0:1788201184.894109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.894125:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201184.894130:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681190400:0@lo:400: 00000100:00100000:3.0:1788201184.894147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.894161:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681190912:0@lo:400: 00000100:00100000:3.0:1788201184.894187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.894200:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681191424:0@lo:400: 00000100:00100000:3.0:1788201184.894218:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.894244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681190528 00000100:00100000:3.0:1788201184.894253:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681190528 00000100:00100000:3.0:1788201184.894297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681190272 00000100:00100000:3.0:1788201184.894300:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681190272 00000100:00100000:3.0:1788201184.894310:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681190784 00000100:00100000:3.0:1788201184.894312:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681190784 00000100:00100000:3.0:1788201184.894332:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681191296 00000100:00100000:3.0:1788201184.894335:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681191296 00000100:00100000:3.0:1788201184.894347:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681190912 00000100:00100000:3.0:1788201184.894355:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681190912 00000100:00100000:3.0:1788201184.894370:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681191424 00000100:00100000:3.0:1788201184.894372:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681191424 00000100:00100000:3.0:1788201184.894389:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201184.894397:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681190528:12345-0@lo:400: 00000100:00100000:3.0:1788201184.894457:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681190528:12345-0@lo:400: Request processed in 59us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.894464:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201184.894481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788201184.894486:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681190272:12345-0@lo:400: 00000100:00100000:3.0:1788201184.894511:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681190272:12345-0@lo:400: Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.894517:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788201184.894526:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201184.894532:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681190784:12345-0@lo:400: 00000100:00100000:3.0:1788201184.894556:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681190784:12345-0@lo:400: Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.894561:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201184.894572:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201184.894577:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681191296:12345-0@lo:400: 00000100:00100000:3.0:1788201184.896035:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681191296:12345-0@lo:400: Request processed in 1451us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.896046:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201184.896080:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201184.896091:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681190912:12345-0@lo:400: 00000100:00100000:3.0:1788201184.896120:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681190912:12345-0@lo:400: Request processed in 34us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.896138:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201184.896151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201184.896157:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681191424:12345-0@lo:400: 00000100:00100000:3.0:1788201184.896185:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681191424:12345-0@lo:400: Request processed in 29us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.896191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201184.896218:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681191040 00000100:00100000:3.0:1788201184.896225:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681191040 00000100:00100000:3.0:1788201184.896254:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681191552 00000100:00100000:3.0:1788201184.896257:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681191552 00000100:00100000:3.0:1788201184.896268:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681191168 00000100:00100000:3.0:1788201184.896271:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681191168 00000100:00100000:3.0:1788201184.896283:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681191680 00000100:00100000:3.0:1788201184.896286:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681191680 00000100:00100000:3.0:1788201184.896298:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201184.896303:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681191040:12345-0@lo:400: 00000100:00100000:3.0:1788201184.896334:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681191040:12345-0@lo:400: Request processed in 30us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.896340:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201184.896351:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201184.896356:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681191552:12345-0@lo:400: 00000100:00100000:3.0:1788201184.896380:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681191552:12345-0@lo:400: Request processed in 25us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.896386:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201184.896394:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201184.896400:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681191168:12345-0@lo:400: 00000100:00100000:3.0:1788201184.896423:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681191168:12345-0@lo:400: Request processed in 24us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.896435:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201184.896445:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201184.896451:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681191680:12345-0@lo:400: 00000100:00100000:3.0:1788201184.896478:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681191680:12345-0@lo:400: Request processed in 28us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.896483:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201184.896508:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681190656 00000100:00100000:3.0:1788201184.896512:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681190656 00000100:00100000:3.0:1788201184.896559:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681190400 00000100:00100000:3.0:1788201184.896563:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681190400 00000100:00100000:3.0:1788201184.896576:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201184.896924:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681190144 00000100:00100000:1.0:1788201184.896930:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681190144 00000100:00100000:1.0:1788201184.896963:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788201184.896970:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681190144:12345-0@lo:400: 00000100:00100000:1.0:1788201184.897009:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681190144:12345-0@lo:400: Request processed in 40us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201184.897015:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788201184.897227:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201184.897238:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681190400:12345-0@lo:400: 00000100:00100000:0.0:1788201184.897275:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681190400:12345-0@lo:400: Request processed in 41us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.897280:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788201184.897329:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201184.897334:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201184.897337:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201184.897339:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201184.898399:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201184.898420:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681191808:0@lo:13: 00000100:00100000:1.0:1788201184.898480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201184.898720:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681190400:0@lo:400: 00010000:00080000:1.0:1788201184.898766:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0380 x1875064681190912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201184.898778:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681190912:0@lo:400: 00010000:00080000:1.0:1788201184.898791:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b2680 x1875064681191424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201184.898811:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681191424:0@lo:400: 00000100:00100000:1.0:1788201184.898829:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681190272:0@lo:400: 00000100:00100000:1.0:1788201184.898842:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681190784:0@lo:400: 00000100:00100000:1.0:1788201184.898855:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681191296:0@lo:400: 00000100:00100000:1.0:1788201184.898897:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681190144:0@lo:400: 00010000:00080000:1.0:1788201184.898910:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b1880 x1875064681191168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201184.898919:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681191168:0@lo:400: 00010000:00080000:1.0:1788201184.898928:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b2d80 x1875064681191680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201184.898936:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681191680:0@lo:400: 00000100:00100000:1.0:1788201184.898948:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681190528:0@lo:400: 00010000:00080000:1.0:1788201184.898959:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0000 x1875064681191040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201184.898980:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681191040:0@lo:400: 00010000:00080000:1.0:1788201184.898993:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b1180 x1875064681191552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201184.899000:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681191552:0@lo:400: 00000100:00100000:3.0:1788201184.899885:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681190656:12345-0@lo:400: 00000100:00100000:3.0:1788201184.899971:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681190656:12345-0@lo:400: Request processed in 3389us (6048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.899980:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201184.900030:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681190656:0@lo:400: 00000100:00100000:3.0:1788201184.900070:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681191808 00000100:00100000:3.0:1788201184.900076:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681191808 00000100:00100000:3.0:1788201184.900108:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201184.900115:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681191808:12345-0@lo:13: 00002000:00000024:3.0:1788201184.900140:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201184.900171:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681191808:12345-0@lo:13: Request processed in 57us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.900177:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788201184.900205:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba2f0380 x1875064681191808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201184.900234:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681191808:0@lo:13: 00000001:00100000:3.0:1788201184.908520:0:7447:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000001:00100000:0.0:1788201184.908939:0:6495:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000100:00100000:0.0:1788201184.966680:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201184.966722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201184.966766:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201184.966788:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201184.966822:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201184.966863:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662265856 00000100:00100000:0.0:1788201184.966874:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662265856 00000100:00100000:0.0:1788201184.966935:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 198 00000100:00100000:0.0:1788201184.966946:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2399:x1875064662265856:12345-192.168.203.2@tcp:400: 00000100:00100000:0.0:1788201184.967030:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2399:x1875064662265856:12345-192.168.203.2@tcp:400: Request processed in 87us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.967038:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 198 00000100:00100000:0.0:1788201184.967076:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662266112 00000100:00100000:0.0:1788201184.967080:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662266112 00000100:00100000:0.0:1788201184.967116:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662265984 00000100:00100000:0.0:1788201184.967119:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662265984 00000100:00100000:0.0:1788201184.967143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1788201184.967150:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662266112:12345-192.168.203.2@tcp:400: 00000100:00100000:0.0:1788201184.967183:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662266112:12345-192.168.203.2@tcp:400: Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.967189:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1788201184.967203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1788201184.967210:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662265984:12345-192.168.203.2@tcp:400: 00000100:00100000:0.0:1788201184.967233:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662265984:12345-192.168.203.2@tcp:400: Request processed in 24us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.967239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1788201184.967256:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662266368 00000100:00100000:0.0:1788201184.967260:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662266368 00000100:00100000:0.0:1788201184.967282:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662266240 00000100:00100000:0.0:1788201184.967284:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662266240 00000100:00100000:0.0:1788201184.967305:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1788201184.967311:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662266368:12345-192.168.203.2@tcp:400: 00000100:00100000:0.0:1788201184.967357:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662266368:12345-192.168.203.2@tcp:400: Request processed in 45us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.967363:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1788201184.967374:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:0.0:1788201184.967380:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662266240:12345-192.168.203.2@tcp:400: 00000100:00100000:0.0:1788201184.967401:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662266240:12345-192.168.203.2@tcp:400: Request processed in 21us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.967406:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00080000:0.0:1788201184.967551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201184.967556:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201184.967558:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201184.967560:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201185.398001:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201185.398033:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681191936:0@lo:13: 00000100:00100000:1.0:1788201185.398116:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201185.398231:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681191936 00000100:00100000:0.0:1788201185.398239:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681191936 00000100:00100000:0.0:1788201185.398297:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201185.398307:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681191936:12345-0@lo:13: 00002000:00000024:0.0:1788201185.398333:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201185.398381:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681191936:12345-0@lo:13: Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201185.398389:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788201185.398430:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e1c4e00 x1875064681191936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201185.398449:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681191936:0@lo:13: 00010000:00010000:3.0:1788201185.472767:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201185.735460:0:10182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788201185.930728:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00010000:00010000:1.0:1788201186.486236:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201186.934150:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681192064:0@lo:41: 00000100:00100000:1.0:1788201186.934245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201186.934426:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681192064 00000100:00100000:2.0:1788201186.934437:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681192064 00000100:00100000:2.0:1788201186.934503:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201186.934516:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681192064:12345-0@lo:41: 00000004:00000024:2.0:1788201186.934562:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788201186.934653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681192064:12345-0@lo:41: Request processed in 139us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201186.934661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201186.934819:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681192064:0@lo:41: 00000100:00100000:1.0:1788201186.934952:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201186.934961:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681192192:0@lo:41: 00000100:00100000:1.0:1788201186.934992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201186.935061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681192192 00000100:00100000:2.0:1788201186.935065:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681192192 00000100:00100000:2.0:1788201186.935100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201186.935107:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681192192:12345-0@lo:41: 00000004:00000024:2.0:1788201186.935129:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201186.935169:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681192192:12345-0@lo:41: Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201186.935175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201186.935204:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681192192:0@lo:41: 00000100:00100000:3.0:1788201187.456953:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681192320:0@lo:13: 00000100:00100000:3.0:1788201187.457048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201187.457251:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681192320 00000100:00100000:2.0:1788201187.457260:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681192320 00000100:00100000:2.0:1788201187.457329:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201187.457338:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681192320:12345-0@lo:13: 00002000:00000024:2.0:1788201187.457371:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201187.457419:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681192320:12345-0@lo:13: Request processed in 82us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201187.457426:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788201187.459725:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201187.459792:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333ce00 x1875064681192320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201187.459816:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681192320:0@lo:13: 00000100:00100000:3.0:1788201187.460264:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681192448:0@lo:13: 00000100:00100000:3.0:1788201187.460316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201187.460394:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681192448 00000100:00100000:2.0:1788201187.460399:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681192448 00000100:00100000:2.0:1788201187.460450:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201187.460458:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681192448:12345-0@lo:13: 00002000:00000024:2.0:1788201187.460476:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201187.460512:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681192448:12345-0@lo:13: Request processed in 55us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201187.460534:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788201187.460600:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201187.460619:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333c700 x1875064681192448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201187.460633:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681192448:0@lo:13: 00010000:00010000:0.0:1788201187.509983:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201188.533982:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201189.551088:0:10330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde247e6d0 20000000:00000080:3.0:1788201189.551102:0:10330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce0bf4ba000 uarg=0000000000000000 20000000:01000000:3.0:1788201189.551139:0:10330:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788201189.551141:0:10330:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788201189.551143:0:10330:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788201189.551148:0:10330:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788201189.551153:0:10330:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788201189.551200:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788201189.551203:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788201189.552408:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788201189.552665:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788201189.552693:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788201189.552708:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788201189.552719:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788201189.552721:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788201189.554085:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1788201189.554337:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1788201189.554362:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1788201189.554374:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1788201189.554384:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788201189.554387:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788201189.554618:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788201189.555180:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788201189.555204:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788201189.555215:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788201189.555224:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788201189.555225:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788201189.555659:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788201189.555902:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788201189.555922:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788201189.555933:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1788201189.555942:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788201189.555944:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788201189.556161:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788201189.556340:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788201189.556356:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788201189.556367:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1788201189.556378:0:10330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788201189.556396:0:10330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556413:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720103 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556421:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472012d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556437:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472016c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556444:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472017a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556450:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720188 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556456:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556462:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447201ce expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556468:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447201ea expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556474:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720214 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556483:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556489:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556495:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556539:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556559:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 9 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.556573:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681192576:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201189.556712:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556721:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 9 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.556729:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681192704:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201189.556788:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720214 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556796:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720214 expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.556805:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681192832:0@lo:104: 00000100:00100000:3.0:1788201189.556839:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201189.556867:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee447201ea expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556874:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee447201ea expref: 23 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.556891:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681192960:0@lo:104: 00000100:00100000:3.0:1788201189.556907:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201189.556925:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee447201ce expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556932:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee447201ce expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.556939:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193088:0@lo:104: 00000100:00100000:3.0:1788201189.556952:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201189.556963:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.556969:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 23 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.556976:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193216:0@lo:104: 00000100:00100000:3.0:1788201189.556990:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201189.557000:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720188 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.557006:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720188 expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.557012:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193344:0@lo:104: 00010000:00010000:3.0:1788201189.557026:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472017a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.557042:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472017a expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.557049:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193472:0@lo:104: 00010000:00010000:3.0:1788201189.557067:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472016c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.557074:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472016c expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.557080:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193600:0@lo:104: 00010000:00010000:3.0:1788201189.557106:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472012d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.557112:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472012d expref: 23 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.557118:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193728:0@lo:104: 00010000:00010000:3.0:1788201189.557132:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720103 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.557138:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720103 expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.557145:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193856:0@lo:104: 00000100:00100000:3.0:1788201189.557155:0:10330:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201189.557283:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201189.557301:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.557312:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.557320:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.557327:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.557334:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.557341:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681192832 00000100:00100000:1.0:1788201189.557346:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681192832 00000100:00100000:1.0:1788201189.557380:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681192960 00000100:00100000:1.0:1788201189.557382:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681192960 00000100:00100000:1.0:1788201189.557392:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681193088 00000100:00100000:1.0:1788201189.557394:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681193088 00000100:00100000:1.0:1788201189.557402:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681193216 00000100:00100000:1.0:1788201189.557410:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681193216 00000100:00100000:1.0:1788201189.557420:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681193344 00000100:00100000:1.0:1788201189.557422:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681193344 00000100:00100000:1.0:1788201189.557429:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681193472 00000100:00100000:1.0:1788201189.557431:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681193472 00000100:00100000:1.0:1788201189.557438:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681193600 00000100:00100000:1.0:1788201189.557440:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681193600 00000100:00100000:1.0:1788201189.557447:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681193728 00000100:00100000:1.0:1788201189.557449:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681193728 00000100:00100000:1.0:1788201189.557456:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681193856 00000100:00100000:1.0:1788201189.557457:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681193856 00000100:00100000:1.0:1788201189.557469:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201189.557476:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:10330:x1875064681192832:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557486:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.557535:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201189.557540:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+11:10330:x1875064681192832:12345-0@lo:104: Request processed in 66us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.557546:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201189.557563:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201189.557567:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:10330:x1875064681192960:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557574:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.557600:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201189.557604:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+10:10330:x1875064681192960:12345-0@lo:104: Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.557609:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201189.557620:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201189.557629:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:10330:x1875064681193088:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557636:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.557662:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201189.557666:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+9:10330:x1875064681193088:12345-0@lo:104: Request processed in 38us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.557671:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201189.557683:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201189.557687:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82526c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+8:10330:x1875064681193216:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557693:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.557713:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788201189.557716:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82526c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+8:10330:x1875064681193216:12345-0@lo:104: Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.557721:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201189.557781:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201189.557786:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+7:10330:x1875064681193344:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557792:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.557813:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788201189.557817:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+7:10330:x1875064681193344:12345-0@lo:104: Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.557823:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201189.557833:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201189.557842:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:10330:x1875064681193472:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557848:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.557868:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788201189.557872:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:10330:x1875064681193472:12345-0@lo:104: Request processed in 31us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.557876:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201189.557887:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201189.557892:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:10330:x1875064681193600:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557897:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.557914:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788201189.557918:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:10330:x1875064681193600:12345-0@lo:104: Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.557922:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201189.557932:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201189.557936:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:10330:x1875064681193728:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557941:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.557957:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1788201189.557961:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:10330:x1875064681193728:12345-0@lo:104: Request processed in 25us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.557965:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201189.557974:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201189.557983:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:10330:x1875064681193856:12345-0@lo:104: 00010000:00010000:1.0:1788201189.557989:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558008:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1788201189.558012:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:10330:x1875064681193856:12345-0@lo:104: Request processed in 30us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.558017:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788201189.558033:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788201189.558038:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558045:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2045800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558049:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558057:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558064:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558069:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558093:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558099:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558115:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558130:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045800/0xf9b71aee44720214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472021b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558154:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201189.558157:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558162:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558165:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558171:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558177:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558181:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558191:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558196:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558200:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558205:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0400/0xf9b71aee447201ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558214:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201189.558220:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558226:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2044000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558229:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558234:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558239:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558243:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558251:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558255:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558266:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558273:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044000/0xf9b71aee447201ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558284:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201189.558287:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558292:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558295:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558310:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558316:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558321:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558331:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558336:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558340:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558346:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447201a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447201ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558354:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201189.558357:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558361:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558364:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558370:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558375:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558384:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558392:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558397:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558400:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558406:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee44720188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472018f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558413:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201189.558415:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558419:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2045000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558422:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558427:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558433:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558438:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558444:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558448:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558455:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558461:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045000/0xf9b71aee4472017a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720181 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558468:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201189.558470:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558475:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2045e00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558478:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558483:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558488:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558493:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558500:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558504:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558506:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558511:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0c2045e00/0xf9b71aee4472016c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720173 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558517:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201189.558523:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558528:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2044a00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558531:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558537:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558542:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558546:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558554:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558558:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558561:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558566:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0c2044a00/0xf9b71aee4472012d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720134 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558572:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201189.558574:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558578:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081671200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201189.558581:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558594:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201189.558600:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201189.558604:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201189.558613:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558617:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201189.558620:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558625:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081671200/0xf9b71aee44720103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472010a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.558636:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201189.558638:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201189.558639:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201189.558646:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201189.558650:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201189.558667:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681194112:0@lo:103: 00000100:00100000:1.0:1788201189.558698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558725:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681194624:0@lo:103: 00000100:00100000:1.0:1788201189.558778:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558796:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788201189.558801:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681193984:0@lo:103: 00000100:00100000:1.0:1788201189.558825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558837:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681194496:0@lo:103: 00000100:00100000:1.0:1788201189.558850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558861:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681195008:0@lo:103: 00000100:00100000:1.0:1788201189.558874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558887:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681194240:0@lo:103: 00000100:00100000:1.0:1788201189.558901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558908:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681194752:0@lo:103: 00000100:00100000:1.0:1788201189.558920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558928:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201189.558932:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681194368:0@lo:103: 00000100:00100000:1.0:1788201189.558945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558950:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681194880:0@lo:103: 00000100:00100000:1.0:1788201189.558962:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.558979:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681194112 00000100:00100000:1.0:1788201189.558983:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681194112 00010000:00010000:1.0:1788201189.559000:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447201ea expref: 24 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559013:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681194624 00000100:00100000:1.0:1788201189.559015:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681194624 00010000:00010000:1.0:1788201189.559022:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472017a expref: 25 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559030:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681193984 00000100:00100000:1.0:1788201189.559032:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681193984 00010000:00010000:1.0:1788201189.559038:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720214 expref: 26 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559055:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681194496 00000100:00100000:1.0:1788201189.559057:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681194496 00010000:00010000:1.0:1788201189.559064:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720188 expref: 27 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559071:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681195008 00000100:00100000:1.0:1788201189.559073:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681195008 00010000:00010000:1.0:1788201189.559079:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720103 expref: 28 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559085:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681194240 00000100:00100000:1.0:1788201189.559087:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681194240 00010000:00010000:1.0:1788201189.559092:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447201ce expref: 29 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559099:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681194752 00000100:00100000:1.0:1788201189.559101:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681194752 00010000:00010000:1.0:1788201189.559108:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472016c expref: 30 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559115:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681194368 00000100:00100000:1.0:1788201189.559116:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681194368 00010000:00010000:1.0:1788201189.559122:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 31 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559130:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681194880 00000100:00100000:1.0:1788201189.559131:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681194880 00010000:00010000:1.0:1788201189.559137:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472012d expref: 32 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.559145:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201189.559154:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+32:3647:x1875064681194112:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559164:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559170:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447201ea expref: 32 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559178:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee447201ea expref: 32 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559191:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559214:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+32:3647:x1875064681194112:12345-0@lo:103: Request processed in 60us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559219:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201189.559250:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201189.559255:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+31:3647:x1875064681194624:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559260:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559264:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472017a expref: 31 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559270:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472017a expref: 31 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559278:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559295:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+31:3647:x1875064681194624:12345-0@lo:103: Request processed in 40us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559301:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201189.559310:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201189.559314:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+30:3647:x1875064681193984:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559319:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559327:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720214 expref: 30 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559334:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720214 expref: 30 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559341:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559357:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+30:3647:x1875064681193984:12345-0@lo:103: Request processed in 43us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559362:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201189.559370:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201189.559374:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+29:3647:x1875064681194496:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559380:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559384:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720188 expref: 29 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559390:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720188 expref: 29 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559397:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559410:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+29:3647:x1875064681194496:12345-0@lo:103: Request processed in 36us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559414:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201189.559422:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201189.559426:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+28:3647:x1875064681195008:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559431:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559434:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720103 expref: 28 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559449:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720103 expref: 28 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559456:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559471:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+28:3647:x1875064681195008:12345-0@lo:103: Request processed in 45us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559475:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201189.559483:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201189.559487:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+27:3644:x1875064681194240:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559492:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559496:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447201ce expref: 27 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559502:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee447201ce expref: 27 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559509:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559525:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+27:3644:x1875064681194240:12345-0@lo:103: Request processed in 38us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559530:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201189.559537:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201189.559542:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+26:3644:x1875064681194752:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559547:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559550:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472016c expref: 26 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559557:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472016c expref: 26 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559569:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559584:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+26:3644:x1875064681194752:12345-0@lo:103: Request processed in 42us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559588:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201189.559597:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201189.559601:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+25:3644:x1875064681194368:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559606:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559609:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 25 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559616:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 25 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559623:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559636:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+25:3644:x1875064681194368:12345-0@lo:103: Request processed in 35us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559640:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201189.559656:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201189.559660:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681194880:12345-0@lo:103: 00010000:00010000:1.0:1788201189.559665:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.559668:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472012d expref: 24 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559675:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472012d expref: 24 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.559682:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.559700:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681194880:12345-0@lo:103: Request processed in 40us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.559705:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201189.559756:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681194368:0@lo:103: 00000100:00100000:1.0:1788201189.559765:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681194880:0@lo:103: 00000100:00100000:1.0:1788201189.559786:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681194240:0@lo:103: 00000100:00100000:1.0:1788201189.559792:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681194752:0@lo:103: 00000100:00100000:1.0:1788201189.559833:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681193984:0@lo:103: 00000100:00100000:1.0:1788201189.559839:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681194496:0@lo:103: 00000100:00100000:1.0:1788201189.559845:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681195008:0@lo:103: 00000100:00100000:1.0:1788201189.559851:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681194112:0@lo:103: 00000100:00100000:1.0:1788201189.559857:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681194624:0@lo:103: 00010000:00010000:3.0:1788201189.560071:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1600/0xf9b71aee4472021b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720214 expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560090:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681192832:0@lo:104: 00010000:00010000:3.0:1788201189.560100:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081670400/0xf9b71aee447201f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee447201ea expref: 22 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560107:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681192960:0@lo:104: 00010000:00010000:3.0:1788201189.560114:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a1c00/0xf9b71aee447201d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee447201ce expref: 21 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560121:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193088:0@lo:104: 00010000:00010000:3.0:1788201189.560128:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081670a00/0xf9b71aee447201ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee447201a4 expref: 20 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560134:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193216:0@lo:104: 00010000:00010000:3.0:1788201189.560141:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74400/0xf9b71aee4472018f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720188 expref: 19 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560148:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193344:0@lo:104: 00010000:00010000:3.0:1788201189.560154:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75e00/0xf9b71aee44720181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472017a expref: 18 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560160:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193472:0@lo:104: 00010000:00010000:3.0:1788201189.560166:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081670c00/0xf9b71aee44720173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472016c expref: 17 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560172:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193600:0@lo:104: 00010000:00010000:3.0:1788201189.560179:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a0e00/0xf9b71aee44720134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472012d expref: 16 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560190:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193728:0@lo:104: 00010000:00010000:3.0:1788201189.560198:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0c2045c00/0xf9b71aee4472010a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720103 expref: 15 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.560205:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681193856:0@lo:104: 00010000:00010000:1.0:1788201189.560684:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201189.564150:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681192576:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201189.564163:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875064681192704:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201189.564207:0:10330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201189.565722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201189.565944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201189.566023:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662266496 00000100:00100000:2.0:1788201189.566035:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662266496 00000100:00100000:1.0:1788201189.566064:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662266624 00000100:00100000:1.0:1788201189.566075:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662266624 00010000:00010000:2.0:1788201189.566084:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 11 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.566110:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 11 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.566130:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:2.0:1788201189.566141:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:2398:x1875064662266496:12345-192.168.203.2@tcp:103: 00010000:00010000:2.0:1788201189.566158:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201189.566164:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 11 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.566179:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 11 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.566196:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720230 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbec1 expref: 11 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.566211:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201189.566275:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2398:x1875064662266496:12345-192.168.203.2@tcp:103: Request processed in 137us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.567000:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:1.0:1788201189.567016:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2398:x1875064662266624:12345-192.168.203.2@tcp:103: 00000100:00100000:2.0:1788201189.567025:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00010000:00010000:1.0:1788201189.567040:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.567054:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 9 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567088:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 9 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567107:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44720229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbeba expref: 9 pid: 6510 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567125:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567134:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567152:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567159:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567165:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567172:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567179:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201189.567184:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567192:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567226:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.567240:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201189.567270:0:10330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.567286:0:10330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.567294:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855ba800/0xf9b71aee4472026f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.567302:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:2398:x1875064662266624:12345-192.168.203.2@tcp:103: Request processed in 290us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.567312:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:2.0:1788201190.006532:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681195136:0@lo:13: 00000100:00100000:2.0:1788201190.006615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201190.006762:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681195136 00000100:00100000:1.0:1788201190.006788:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681195136 00000100:00100000:1.0:1788201190.006849:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201190.006859:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681195136:12345-0@lo:13: 00002000:00000024:1.0:1788201190.006885:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788201190.006942:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201190.007145:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681195136:12345-0@lo:13: Request processed in 287us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.007152:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201190.009711:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681195520:0@lo:400: 00000100:00100000:3.0:1788201190.009985:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681195264:0@lo:400: 00000100:00100000:3.0:1788201190.010028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.010063:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681195776:0@lo:400: 00000100:00100000:3.0:1788201190.010087:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.010111:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681196288:0@lo:400: 00000100:00100000:3.0:1788201190.010135:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.010160:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201190.010166:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681195392:0@lo:400: 00000100:00100000:3.0:1788201190.010189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.010206:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681195904:0@lo:400: 00000100:00100000:3.0:1788201190.010227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.010245:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681196416:0@lo:400: 00000100:00100000:3.0:1788201190.010265:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.010336:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681195776 00000100:00100000:3.0:1788201190.010352:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681195776 00000100:00100000:3.0:1788201190.010410:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201190.010419:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681195776:12345-0@lo:400: 00000100:00100000:3.0:1788201190.010472:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681195776:12345-0@lo:400: Request processed in 54us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.010479:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201190.010522:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681195776:0@lo:400: 00000100:00100000:3.0:1788201190.010552:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681195392 00000100:00100000:3.0:1788201190.010555:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681195392 00000100:00100000:3.0:1788201190.010578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681195904 00000100:00100000:3.0:1788201190.010581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681195904 00000100:00100000:3.0:1788201190.010598:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681196416 00000100:00100000:3.0:1788201190.010601:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681196416 00000100:00100000:3.0:1788201190.010614:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201190.010619:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681195392:12345-0@lo:400: 00000100:00100000:3.0:1788201190.010653:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681195392:12345-0@lo:400: Request processed in 33us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.010658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201190.010669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201190.010674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681195904:12345-0@lo:400: 00000100:00100000:3.0:1788201190.010701:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681195904:12345-0@lo:400: Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.010706:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201190.010717:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201190.010723:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681196416:12345-0@lo:400: 00000100:00100000:3.0:1788201190.010787:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681196416:12345-0@lo:400: Request processed in 64us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.010805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201190.010825:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681196288 00000100:00100000:3.0:1788201190.010828:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681196288 00000100:00100000:3.0:1788201190.011066:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201190.011073:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681196288:12345-0@lo:400: 00000100:00100000:3.0:1788201190.011107:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681196288:12345-0@lo:400: Request processed in 35us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.011113:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788201190.011129:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201190.011133:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201190.011155:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681195392:0@lo:400: 00000100:00100000:3.0:1788201190.011166:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681195904:0@lo:400: 00000100:00100000:3.0:1788201190.011176:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681196416:0@lo:400: 00010000:00080000:3.0:1788201190.011189:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50d880 x1875064681196288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201190.011198:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681196288:0@lo:400: 00000100:00100000:0.0:1788201190.011513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.011545:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681196032:0@lo:400: 00000100:00100000:0.0:1788201190.011573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.011590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681196544:0@lo:400: 00000100:00100000:0.0:1788201190.011611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.011631:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201190.011638:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681195648:0@lo:400: 00000100:00100000:0.0:1788201190.011659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.011676:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681196160:0@lo:400: 00000100:00100000:0.0:1788201190.011699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.011717:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681196672:0@lo:400: 00000100:00100000:0.0:1788201190.011752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.011789:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681196160 00000100:00100000:0.0:1788201190.011794:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681196160 00000100:00100000:0.0:1788201190.011824:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681196672 00000100:00100000:0.0:1788201190.011827:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681196672 00000100:00100000:0.0:1788201190.011922:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201190.011930:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681196160:12345-0@lo:400: 00000100:00100000:0.0:1788201190.011972:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681196160:12345-0@lo:400: Request processed in 43us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.011989:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201190.012003:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201190.012010:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681196672:12345-0@lo:400: 00000100:00100000:0.0:1788201190.012040:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681196672:12345-0@lo:400: Request processed in 31us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.012045:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201190.012067:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681196032 00000100:00100000:0.0:1788201190.012071:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681196032 00000100:00100000:0.0:1788201190.012094:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681196544 00000100:00100000:0.0:1788201190.012096:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681196544 00000100:00100000:0.0:1788201190.012106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681195648 00000100:00100000:0.0:1788201190.012108:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681195648 00000100:00100000:0.0:1788201190.012118:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201190.012124:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681196032:12345-0@lo:400: 00000100:00100000:0.0:1788201190.012155:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681196032:12345-0@lo:400: Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.012161:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201190.012172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201190.012178:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681196544:12345-0@lo:400: 00000100:00100000:0.0:1788201190.012204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681196544:12345-0@lo:400: Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.012209:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201190.012219:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201190.012225:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681195648:12345-0@lo:400: 00000100:00100000:0.0:1788201190.012249:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681195648:12345-0@lo:400: Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.012263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201190.012529:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681195264 00000100:00100000:1.0:1788201190.012534:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681195264 00000100:00100000:1.0:1788201190.012568:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788201190.012575:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3644:x1875064681195264:12345-0@lo:400: 00000100:00100000:1.0:1788201190.012618:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:3644:x1875064681195264:12345-0@lo:400: Request processed in 44us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.012625:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788201190.012670:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681195264:0@lo:400: 00000100:00100000:3.0:1788201190.012774:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681195520 00000100:00100000:3.0:1788201190.012780:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681195520 00000100:00100000:3.0:1788201190.012810:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201190.012817:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681195520:12345-0@lo:400: 00000100:00100000:3.0:1788201190.012867:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681195520:12345-0@lo:400: Request processed in 50us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.012873:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788201190.016682:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201190.016696:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201190.016699:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201190.016893:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681195648:0@lo:400: 00010000:00080000:1.0:1788201190.016912:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50c000 x1875064681196160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201190.016922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681196160:0@lo:400: 00010000:00080000:1.0:1788201190.016935:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50d180 x1875064681196672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201190.016943:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681196672:0@lo:400: 00000100:00100000:1.0:1788201190.016955:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681195520:0@lo:400: 00010000:00080000:1.0:1788201190.016967:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50c380 x1875064681196032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201190.016974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681196032:0@lo:400: 00010000:00080000:1.0:1788201190.016986:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50e680 x1875064681196544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201190.016995:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681196544:0@lo:400: 00010000:00080000:2.0:1788201190.027524:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12ce00 x1875064681195136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201190.027555:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681195136:0@lo:13: 00000100:00100000:0.0:1788201190.081685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201190.081902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201190.082274:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662266752 00000100:00100000:3.0:1788201190.082284:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662266752 00000100:00100000:3.0:1788201190.083236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:3.0:1788201190.083248:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662266752:12345-192.168.203.2@tcp:400: 00000100:00080000:0.0:1788201190.083558:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201190.083706:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662267008 00000100:00100000:1.0:1788201190.083714:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662267008 00000100:00100000:1.0:1788201190.083802:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:1.0:1788201190.083810:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662267008:12345-192.168.203.2@tcp:400: 00000100:00080000:0.0:1788201190.083928:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201190.085324:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662266752:12345-192.168.203.2@tcp:400: Request processed in 2070us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.085337:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:1.0:1788201190.085829:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662267008:12345-192.168.203.2@tcp:400: Request processed in 2017us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.085839:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:3.0:1788201190.086066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201190.086143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201190.086345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662266880 00000100:00100000:1.0:1788201190.086353:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662266880 00000100:00100000:1.0:1788201190.086439:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:1.0:1788201190.086450:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662266880:12345-192.168.203.2@tcp:400: 00000100:00080000:3.0:1788201190.086488:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201190.086526:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662266880:12345-192.168.203.2@tcp:400: Request processed in 78us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.086535:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:2.0:1788201190.086688:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662267136 00000100:00100000:2.0:1788201190.086694:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662267136 00000100:00100000:3.0:1788201190.090854:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1788201190.090873:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662267136:12345-192.168.203.2@tcp:400: 00000100:00100000:3.0:1788201190.090977:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662267136:12345-192.168.203.2@tcp:400: Request processed in 109us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.090985:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00080000:0.0:1788201190.091054:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201190.518142:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681196800:0@lo:13: 00000100:00100000:1.0:1788201190.518240:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.518596:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681196800 00000100:00100000:3.0:1788201190.518606:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681196800 00000100:00100000:3.0:1788201190.518670:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201190.518682:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681196800:12345-0@lo:13: 00002000:00000024:3.0:1788201190.518713:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201190.518826:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681196800:12345-0@lo:13: Request processed in 145us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.518835:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788201190.519067:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50fb80 x1875064681196800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201190.519090:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681196800:0@lo:13: 00010000:00010000:1.0:1788201190.582921:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201190.785436:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201190.785565:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662267264 00000100:00100000:1.0:1788201190.785581:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662267264 00000100:00100000:1.0:1788201190.785661:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 200 00000100:00100000:1.0:1788201190.785674:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:6171:x1875064662267264:12345-192.168.203.2@tcp:101: 00010000:00010000:1.0:1788201190.785697:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201190.785723:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254400/0xf9b71aee44720276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbf31 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.785807:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254400/0xf9b71aee44720276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf31 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.785821:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254400/0xf9b71aee44720276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf31 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.785832:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254400, rc 0) 00000100:00100000:1.0:1788201190.785911:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6171:x1875064662267264:12345-192.168.203.2@tcp:101: Request processed in 240us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.785921:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 200 00000100:00100000:2.0:1788201190.801591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201190.804291:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662267392 00000100:00100000:1.0:1788201190.804344:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662267392 00000100:00100000:1.0:1788201190.804443:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 201 00000100:00100000:1.0:1788201190.804456:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6171:x1875064662267392:12345-192.168.203.2@tcp:501: 00000100:00100000:1.0:1788201190.804693:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6171:x1875064662267392:12345-192.168.203.2@tcp:501: Request processed in 239us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.804701:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 201 00000100:00100000:3.0:1788201190.814811:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201190.814989:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662267520 00000100:00100000:2.0:1788201190.815004:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662267520 00000100:00100000:2.0:1788201190.815076:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 202 00000100:00100000:2.0:1788201190.815089:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6171:x1875064662267520:12345-192.168.203.2@tcp:503: 00000100:00100000:2.0:1788201190.815363:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6171:x1875064662267520:12345-192.168.203.2@tcp:503: Request processed in 275us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201190.815429:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 202 00000100:00100000:0.0:1788201190.830992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201190.831143:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662267648 00000100:00100000:1.0:1788201190.831219:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662267648 00000100:00100000:1.0:1788201190.831343:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00100000:1.0:1788201190.831357:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6651:x1875064662267648:12345-192.168.203.2@tcp:502: 00000100:00100000:1.0:1788201190.831624:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6651:x1875064662267648:12345-192.168.203.2@tcp:502: Request processed in 268us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.831633:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00100000:3.0:1788201190.834851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201190.835058:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662267776 00000100:00100000:0.0:1788201190.835071:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662267776 00000100:00100000:0.0:1788201190.835138:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:0.0:1788201190.835164:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6651:x1875064662267776:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201190.835369:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6651:x1875064662267776:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 219us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.835379:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:3.0:1788201190.850062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201190.850324:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662267904 00000100:00100000:1.0:1788201190.850341:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662267904 00000100:00100000:1.0:1788201190.850562:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 205 00000100:00100000:1.0:1788201190.850584:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6171:x1875064662267904:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201190.850616:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201190.850641:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255c00/0xf9b71aee4472027d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbf38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.850679:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255c00/0xf9b71aee4472027d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf38 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.850692:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255c00/0xf9b71aee4472027d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf38 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.850703:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255c00, rc 0) 00000100:00100000:1.0:1788201190.850830:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6171:x1875064662267904:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 257us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.850838:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 205 00000100:00100000:3.0:1788201190.857473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201190.861817:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662268032 00000100:00100000:0.0:1788201190.861840:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662268032 00000100:00100000:0.0:1788201190.861926:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 206 00000100:00100000:0.0:1788201190.861938:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6171:x1875064662268032:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201190.863856:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6171:x1875064662268032:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 1907us (6385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201190.863870:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 206 10000000:01000000:1.0:1788201190.965895:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201190.965907:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cdf81977800 from 48 10000000:01000000:1.0:1788201190.965914:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201190.965982:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.965998:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.966013:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201190.966046:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681196928:0@lo:101: 00000100:00100000:1.0:1788201190.966142:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201190.966238:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0868530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201190.968121:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681196928 00000100:00100000:0.0:1788201190.968141:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681196928 00000100:00100000:0.0:1788201190.968229:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788201190.968241:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+15:6513:x1875064681196928:12345-0@lo:101: 00010000:00010000:0.0:1788201190.968274:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201190.968299:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74000/0xf9b71aee4472028b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201190.968337:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74000/0xf9b71aee4472028b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720284 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201190.968352:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74000/0xf9b71aee4472028b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720284 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201190.968363:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74000, rc 0) 00000100:00100000:0.0:1788201190.968465:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681196928:12345-0@lo:101: Request processed in 226us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.968472:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788201190.969151:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681196928:0@lo:101: 00010000:00010000:2.0:1788201190.969178:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.969190:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201190.969298:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197056:0@lo:501: 00000100:00100000:2.0:1788201190.969347:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.969428:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201190.969814:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681197056 00000100:00100000:1.0:1788201190.969821:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681197056 00000100:00100000:1.0:1788201190.969868:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788201190.969879:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681197056:12345-0@lo:501: 00000100:00100000:1.0:1788201190.970050:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681197056:12345-0@lo:501: Request processed in 172us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.970057:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788201190.970611:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197056:0@lo:501: 00000100:00100000:2.0:1788201190.970672:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197184:0@lo:503: 00000100:00100000:2.0:1788201190.970716:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.970811:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201190.970918:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681197184 00000100:00100000:0.0:1788201190.970925:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681197184 00000100:00100000:0.0:1788201190.970970:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788201190.970977:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681197184:12345-0@lo:503: 00000100:00100000:0.0:1788201190.971082:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681197184:12345-0@lo:503: Request processed in 104us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.971089:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788201190.971490:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197184:0@lo:503: 00000100:00100000:2.0:1788201190.975267:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10347:1875064681197312:0@lo:502: 00000100:00100000:2.0:1788201190.975709:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.975796:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201190.976105:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681197312 00000100:00100000:0.0:1788201190.976122:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681197312 00000100:00100000:0.0:1788201190.976203:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788201190.976214:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:10347:x1875064681197312:12345-0@lo:502: 00000100:00100000:0.0:1788201190.976430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:10347:x1875064681197312:12345-0@lo:502: Request processed in 216us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.976439:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788201190.978072:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10347:1875064681197312:0@lo:502: 00000100:00100000:2.0:1788201190.978188:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10347:1875064681197440:0@lo:502: 00000100:00100000:2.0:1788201190.978289:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.978345:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201190.978810:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681197440 00000100:00100000:3.0:1788201190.978828:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681197440 00000100:00100000:3.0:1788201190.978884:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788201190.978895:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:10347:x1875064681197440:12345-0@lo:502: 00000100:00100000:3.0:1788201190.979043:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:10347:x1875064681197440:12345-0@lo:502: Request processed in 150us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.979050:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788201190.979222:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10347:1875064681197440:0@lo:502: 00000040:00080000:2.0:1788201190.979268:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788201190.984409:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788201190.984813:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201190.984831:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.984875:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201190.984889:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788201190.984892:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788201190.984896:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201190.984949:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.984958:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.984973:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201190.985004:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197568:0@lo:101: 00000100:00100000:1.0:1788201190.985094:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201190.986726:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0868533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201190.990712:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681197568 00000100:00100000:0.0:1788201190.990732:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681197568 00000100:00100000:0.0:1788201190.990989:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788201190.991003:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+16:6513:x1875064681197568:12345-0@lo:101: 00010000:00010000:0.0:1788201190.991029:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201190.991053:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74800/0xf9b71aee44720299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720292 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201190.991090:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74800/0xf9b71aee44720299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720292 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201190.991104:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74800/0xf9b71aee44720299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720292 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201190.991116:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74800, rc 0) 00000100:00100000:0.0:1788201190.991226:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681197568:12345-0@lo:101: Request processed in 218us (6124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.991235:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788201190.991714:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197568:0@lo:101: 00010000:00010000:1.0:1788201190.997720:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.997798:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201190.997974:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197696:0@lo:501: 00000100:00100000:1.0:1788201190.998078:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201190.998194:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0868533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201190.999962:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681197696 00000100:00100000:0.0:1788201190.999978:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681197696 00000100:00100000:0.0:1788201191.000047:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788201191.000059:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681197696:12345-0@lo:501: 00000100:00100000:0.0:1788201191.000240:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681197696:12345-0@lo:501: Request processed in 183us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.000248:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788201191.000381:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197696:0@lo:501: 00000100:00100000:1.0:1788201191.000919:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197824:0@lo:503: 00000100:00100000:0.0:1788201191.001970:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.002023:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0868533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201191.002540:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681197824 00000100:00100000:3.0:1788201191.002550:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681197824 00000100:00100000:3.0:1788201191.002603:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788201191.002612:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681197824:12345-0@lo:503: 00000100:00100000:3.0:1788201191.002847:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681197824:12345-0@lo:503: Request processed in 234us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201191.002859:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788201191.005696:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681197824:0@lo:503: 00000100:00100000:0.0:1788201191.006313:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10348:1875064681197952:0@lo:502: 00000100:00100000:0.0:1788201191.006375:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.006411:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.006467:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681197952 00000100:00100000:1.0:1788201191.006481:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681197952 00000100:00100000:1.0:1788201191.006585:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788201191.006597:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:10348:x1875064681197952:12345-0@lo:502: 00000100:00100000:1.0:1788201191.007021:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:10348:x1875064681197952:12345-0@lo:502: Request processed in 426us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201191.007031:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788201191.007399:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10348:1875064681197952:0@lo:502: 00000020:01000000:2.0:1788201191.007594:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201191.007710:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201191.007714:0:10348:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201191.007722:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788201191.007809:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10348:1875064681198080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201191.007868:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201191.007977:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201191.012955:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681198080 00000100:00100000:3.0:1788201191.012974:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681198080 00000100:00100000:3.0:1788201191.013107:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788201191.013119:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:10348:x1875064681198080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201191.013388:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:10348:x1875064681198080:12345-0@lo:502:llog_process_th.0 Request processed in 270us (5518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201191.013398:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788201191.013520:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10348:1875064681198080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201191.013562:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201191.013588:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201191.013591:0:10348:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201191.013597:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788201191.017388:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788201191.017446:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201191.017463:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.017479:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201191.017492:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201191.017504:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0b95bd800 from 48 10000000:01000000:0.0:1788201191.017508:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201191.017567:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.017584:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.017604:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201191.017640:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.017731:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.026020:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.026926:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681198208 00000100:00100000:1.0:1788201191.026946:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681198208 00000100:00100000:1.0:1788201191.028180:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788201191.028199:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+17:6513:x1875064681198208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201191.028224:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201191.028250:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255000/0xf9b71aee447202a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447202a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.030712:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255000/0xf9b71aee447202a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447202a0 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.031080:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255000/0xf9b71aee447202a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447202a0 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.031211:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255000, rc 0) 00000100:00100000:1.0:1788201191.031992:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681198208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3792us (14254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201191.032004:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788201191.032712:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201191.034336:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.034365:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201191.034836:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.034934:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.035011:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.038663:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681198336 00000100:00100000:2.0:1788201191.038684:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681198336 00000100:00100000:2.0:1788201191.038801:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788201191.038816:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681198336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.039065:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681198336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.039074:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788201191.039884:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.039965:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.040048:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.040095:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.041321:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681198464 00000100:00100000:2.0:1788201191.041336:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681198464 00000100:00100000:2.0:1788201191.041729:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788201191.041779:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681198464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.041963:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681198464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.042040:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.044433:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10349:1875064681198592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.044770:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.044830:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.044933:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681198592 00000100:00100000:1.0:1788201191.044941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681198592 00000100:00100000:2.0:1788201191.047329:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788201191.047483:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788201191.047515:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:10349:x1875064681198592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201191.047819:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:10349:x1875064681198592:12345-0@lo:502:llog_process_th.0 Request processed in 317us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201191.047828:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788201191.048075:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10349:1875064681198592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201191.048182:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10349:1875064681198720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201191.048243:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201191.048280:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.048410:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681198720 00000100:00100000:0.0:1788201191.048418:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681198720 00000100:00100000:0.0:1788201191.048454:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788201191.048462:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:10349:x1875064681198720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.048563:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:10349:x1875064681198720:12345-0@lo:502:llog_process_th.0 Request processed in 101us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.048570:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788201191.049388:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10349:1875064681198720:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201191.049425:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788201191.049862:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788201191.049888:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201191.049901:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.049913:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201191.050001:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788201191.050005:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788201191.050009:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201191.050050:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.050060:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.050073:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201191.050096:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.051803:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201191.051859:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681198848 00000100:00100000:2.0:1788201191.051871:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681198848 00000100:00100000:0.0:1788201191.051875:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.051953:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788201191.051966:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+18:6513:x1875064681198848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201191.051991:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201191.052014:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0600/0xf9b71aee447202b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447202ae expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.052047:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0600/0xf9b71aee447202b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447202ae expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.052061:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0600/0xf9b71aee447202b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447202ae expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.052088:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0600, rc 0) 00000100:00100000:2.0:1788201191.052171:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681198848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.052178:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788201191.053289:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201191.053317:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.053330:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201191.053452:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.053504:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.053569:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.053630:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681198976 00000100:00100000:1.0:1788201191.053638:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681198976 00000100:00100000:1.0:1788201191.053692:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788201191.053703:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681198976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.053917:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681198976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201191.053925:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788201191.054917:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681198976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.054986:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681199104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.055058:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.055102:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.055168:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681199104 00000100:00100000:1.0:1788201191.055175:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681199104 00000100:00100000:1.0:1788201191.055224:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788201191.055234:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681199104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.055374:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681199104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201191.055381:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788201191.055533:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681199104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.061255:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10350:1875064681199232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.061391:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.061454:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.061799:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681199232 00000100:00100000:1.0:1788201191.061810:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681199232 00000100:00100000:1.0:1788201191.061883:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788201191.061896:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:10350:x1875064681199232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201191.062106:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:10350:x1875064681199232:12345-0@lo:502:llog_process_th.0 Request processed in 211us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201191.062115:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788201191.062321:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10350:1875064681199232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201191.062360:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201191.062373:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201191.062376:0:10350:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201191.062381:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788201191.062421:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10350:1875064681199360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.062461:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.062494:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.062810:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681199360 00000100:00100000:2.0:1788201191.062817:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681199360 00000100:00100000:2.0:1788201191.062864:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788201191.062874:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:10350:x1875064681199360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201191.062989:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:10350:x1875064681199360:12345-0@lo:502:llog_process_th.0 Request processed in 117us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.062998:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788201191.063021:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10350:1875064681199360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201191.063045:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201191.063050:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201191.063052:0:10350:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788201191.063066:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788201191.063194:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788201191.063218:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201191.063233:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.063246:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201191.063259:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201191.063263:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce09e1da800 from 48 10000000:01000000:1.0:1788201191.063267:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201191.063301:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.063310:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.063321:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201191.063338:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681199488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.063371:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201191.063446:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201191.063733:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681199488 00000100:00100000:3.0:1788201191.063789:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681199488 00000100:00100000:3.0:1788201191.063879:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788201191.063889:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:6513:x1875064681199488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201191.063902:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201191.063918:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bb000/0xf9b71aee447202c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447202bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201191.063958:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bb000/0xf9b71aee447202c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447202bc expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201191.063972:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bb000/0xf9b71aee447202c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447202bc expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201191.063984:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb000, rc 0) 00000100:00100000:3.0:1788201191.064030:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681199488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201191.064037:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788201191.064124:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681199488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201191.064140:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.064156:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201191.064217:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681199616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.064252:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201191.065634:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681199616 00000100:00100000:2.0:1788201191.065650:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681199616 00000100:00100000:2.0:1788201191.065730:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788201191.065776:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681199616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.066134:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.066590:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681199616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 847us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.066603:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788201191.066622:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681199616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.066684:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681199744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.066735:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.066810:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.066811:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681199744 00000100:00100000:1.0:1788201191.066818:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681199744 00000100:00100000:1.0:1788201191.066848:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788201191.066857:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681199744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.066966:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681199744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201191.066973:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788201191.067062:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681199744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.071503:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10351:1875064681199872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201191.071633:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201191.071692:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.072129:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681199872 00000100:00100000:2.0:1788201191.072150:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681199872 00000100:00100000:2.0:1788201191.072389:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788201191.072402:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:10351:x1875064681199872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201191.072603:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:10351:x1875064681199872:12345-0@lo:502:llog_process_th.0 Request processed in 202us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.072612:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788201191.072932:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10351:1875064681199872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201191.073008:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10351:1875064681200000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201191.073052:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201191.073089:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.073249:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681200000 00000100:00100000:0.0:1788201191.073255:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681200000 00000100:00100000:0.0:1788201191.073298:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788201191.073307:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:10351:x1875064681200000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.073402:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:10351:x1875064681200000:12345-0@lo:502:llog_process_th.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.073409:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788201191.073463:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10351:1875064681200000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201191.073484:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788201191.074142:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788201191.074171:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201191.074192:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.074205:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201191.074218:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788201191.074221:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788201191.074224:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201191.074259:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.074283:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.074295:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201191.074318:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.074362:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.074403:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.074417:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681200128 00000100:00100000:1.0:1788201191.074424:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681200128 00000100:00100000:1.0:1788201191.074466:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788201191.074476:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681200128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201191.074488:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201191.074503:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254600/0xf9b71aee447202d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447202ca expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.074530:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254600/0xf9b71aee447202d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447202ca expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.074558:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254600/0xf9b71aee447202d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447202ca expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.074568:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254600, rc 0) 00000100:00100000:1.0:1788201191.074617:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681200128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201191.074628:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788201191.075871:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201191.075902:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.075916:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201191.076014:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.076067:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201191.076111:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.078328:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681200256 00000100:00100000:0.0:1788201191.078346:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681200256 00000100:00100000:0.0:1788201191.078429:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788201191.078441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681200256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.078969:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681200256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 529us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.078979:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788201191.079250:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.079312:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.079382:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201191.079424:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.079523:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681200384 00000100:00100000:0.0:1788201191.079529:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681200384 00000100:00100000:0.0:1788201191.079574:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788201191.079583:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681200384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.079983:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681200384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 400us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.079991:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788201191.080076:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.080516:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10352:1875064681200512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201191.080578:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201191.080613:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201191.080725:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681200512 00000100:00100000:1.0:1788201191.080731:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681200512 00000100:00100000:1.0:1788201191.080808:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788201191.080818:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:10352:x1875064681200512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201191.080941:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:10352:x1875064681200512:12345-0@lo:502:llog_process_th.0 Request processed in 124us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201191.080949:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788201191.081063:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10352:1875064681200512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201191.081096:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201191.081108:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201191.081118:0:10352:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201191.081126:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788201191.081165:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10352:1875064681200640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201191.081205:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201191.081236:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.081260:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681200640 00000100:00100000:0.0:1788201191.081266:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681200640 00000100:00100000:0.0:1788201191.081300:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788201191.081315:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:10352:x1875064681200640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.081405:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:10352:x1875064681200640:12345-0@lo:502:llog_process_th.0 Request processed in 91us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.081412:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788201191.081507:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10352:1875064681200640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201191.081526:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201191.081530:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201191.081532:0:10352:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201191.081536:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788201191.081874:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788201191.081901:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788201191.081913:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.081925:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201191.081937:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201191.081940:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0889be000 from 48 10000000:01000000:0.0:1788201191.081944:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201191.081979:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.081988:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.081998:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201191.082013:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.082045:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.082067:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.082290:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681200768 00000100:00100000:2.0:1788201191.082297:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681200768 00000100:00100000:2.0:1788201191.082335:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788201191.082343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681200768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201191.082354:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201191.082369:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0400/0xf9b71aee447202df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447202d8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.082409:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0400/0xf9b71aee447202df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447202d8 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.082422:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0400/0xf9b71aee447202df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447202d8 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.082432:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0400, rc 0) 00000100:00100000:2.0:1788201191.082473:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681200768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.082480:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788201191.089012:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201191.089054:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201191.089071:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201191.089919:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201191.090012:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201191.090066:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.090866:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681200896 00000100:00100000:2.0:1788201191.090877:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681200896 00000100:00100000:2.0:1788201191.090974:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788201191.090986:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681200896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.091183:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681200896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.091192:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788201191.091299:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681200896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201191.091343:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681201024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201191.091408:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201191.097575:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.101057:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681201024 00000100:00100000:0.0:1788201191.101080:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681201024 00000100:00100000:0.0:1788201191.101334:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788201191.101347:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681201024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.101848:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681201024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 502us (10437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.101858:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788201191.103267:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681201024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.114406:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10353:1875064681201152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.114535:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.114596:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e73540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201191.114652:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681201152 00000100:00100000:3.0:1788201191.114678:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681201152 00000100:00100000:3.0:1788201191.114777:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788201191.114789:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:10353:x1875064681201152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201191.114956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:10353:x1875064681201152:12345-0@lo:502:llog_process_th.0 Request processed in 169us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201191.114965:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788201191.115203:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10353:1875064681201152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.115260:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10353:1875064681201280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.115300:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.115323:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.115436:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681201280 00000100:00100000:2.0:1788201191.115441:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681201280 00000100:00100000:2.0:1788201191.115479:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788201191.115488:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:10353:x1875064681201280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201191.115574:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:10353:x1875064681201280:12345-0@lo:502:llog_process_th.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.115580:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788201191.115688:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10353:1875064681201280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201191.115709:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788201191.116044:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788201191.116067:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201191.116079:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201191.116091:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201191.116104:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788201191.116107:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788201191.116110:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201191.116150:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201191.116160:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201191.116172:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201191.116188:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681201408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201191.116222:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201191.116252:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.116360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681201408 00000100:00100000:2.0:1788201191.116365:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681201408 00000100:00100000:2.0:1788201191.116411:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788201191.116418:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681201408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201191.116428:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201191.116442:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0a00/0xf9b71aee447202ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447202e6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.116469:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0a00/0xf9b71aee447202ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447202e6 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.116481:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0a00/0xf9b71aee447202ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447202e6 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.116492:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0a00, rc 0) 00000100:00100000:2.0:1788201191.116536:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681201408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.116542:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788201191.116615:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681201408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201191.116630:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.116640:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201191.116706:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681201536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.116733:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.116870:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.117150:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681201536 00000100:00100000:2.0:1788201191.117155:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681201536 00000100:00100000:2.0:1788201191.117190:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788201191.117198:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681201536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.117340:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681201536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.117347:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788201191.117482:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681201536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.117521:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681201664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.117570:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201191.117593:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.117641:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681201664 00000100:00100000:0.0:1788201191.117652:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681201664 00000100:00100000:0.0:1788201191.117689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788201191.117695:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681201664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.117829:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681201664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.117837:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788201191.117986:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681201664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.120770:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10354:1875064681201792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201191.120887:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201191.120940:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.121019:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681201792 00000100:00100000:0.0:1788201191.121028:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681201792 00000100:00100000:0.0:1788201191.121076:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788201191.121088:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:10354:x1875064681201792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.121254:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:10354:x1875064681201792:12345-0@lo:502:llog_process_th.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.121262:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788201191.121404:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10354:1875064681201792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201191.121446:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201191.121458:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201191.121461:0:10354:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201191.121468:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788201191.121491:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10354:1875064681201920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201191.121525:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201191.121553:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201191.121728:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681201920 00000100:00100000:0.0:1788201191.121732:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681201920 00000100:00100000:0.0:1788201191.121790:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788201191.121796:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:10354:x1875064681201920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201191.121863:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:10354:x1875064681201920:12345-0@lo:502:llog_process_th.0 Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.121870:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788201191.121970:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10354:1875064681201920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201191.121989:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201191.121994:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201191.121996:0:10354:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201191.122000:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788201191.122304:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788201191.122329:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201191.122342:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.122354:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201191.122379:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788201191.122381:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ce0b2520000 from 1 10000000:01000000:0.0:1788201191.122384:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788201191.122416:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.122425:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201191.122436:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201191.122455:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681202048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201191.122496:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201191.122535:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.122587:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681202048 00000100:00100000:2.0:1788201191.122593:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681202048 00000100:00100000:2.0:1788201191.122637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788201191.122646:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681202048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201191.122658:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201191.122691:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1800/0xf9b71aee447202fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447202f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.122717:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1800/0xf9b71aee447202fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447202f4 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.122729:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1800/0xf9b71aee447202fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447202f4 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201191.122786:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1800, rc 0) 00000100:00100000:2.0:1788201191.122832:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681202048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.122839:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788201191.123059:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681202048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201191.123075:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202fb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.123085:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202fb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201191.123162:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681202176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201191.123193:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201191.123213:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201191.123332:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681202176 00000100:00100000:2.0:1788201191.123337:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681202176 00000100:00100000:2.0:1788201191.123370:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788201191.123377:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681202176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201191.123470:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681202176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (275us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201191.123478:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788201191.123712:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681202176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201191.123768:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201191.123777:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202fb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.123802:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202fb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201191.606107:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201192.057249:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681202304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201192.057346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201192.057621:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681202304 00000100:00100000:1.0:1788201192.057631:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681202304 00000100:00100000:1.0:1788201192.057921:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201192.057935:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681202304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201192.057985:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201192.058111:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681202304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201192.058119:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788201192.058533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201192.058550:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681202432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201192.058602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201192.058819:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681202432 00000100:00100000:3.0:1788201192.058838:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681202432 00000100:00100000:3.0:1788201192.058889:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201192.058901:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681202432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201192.058929:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201192.058975:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681202432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201192.058983:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201192.059849:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681202432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201192.062172:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681202304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201192.566960:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201192.567010:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681202560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201192.567101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201192.567194:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681202560 00000100:00100000:3.0:1788201192.567205:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681202560 00000100:00100000:2.0:1788201192.567424:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681202688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201192.567458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201192.567512:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681202688 00000100:00100000:2.0:1788201192.567521:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681202688 00000100:00100000:3.0:1788201192.569075:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201192.569094:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681202560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201192.569137:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201192.569239:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681202560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201192.569254:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788201192.570074:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201192.570153:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834cdc00 x1875064681202560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201192.570699:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201192.570710:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681202688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201192.570733:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788201192.570877:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333c700 x1875064681202688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201192.570896:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681202688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201192.570912:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681202560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201192.570963:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681202688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 255us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201192.570971:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1788201192.630900:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201192.839499:0:10391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd209d840 20000000:00000080:3.0:1788201192.839525:0:10391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cdf82525800 uarg=0000000000000000 20000000:01000000:3.0:1788201192.839566:0:10391:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788201192.839572:0:10391:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788201192.839577:0:10391:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788201192.840141:0:10392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788201192.840254:0:10391:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788201192.844871:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788201192.844922:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788201192.844937:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788201192.844956:0:10391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788201192.844982:0:10391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845003:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75600/0xf9b71aee4471ff9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845010:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845016:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845023:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472011f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845032:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845039:0:10391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845087:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845124:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 9 pid: 6510 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201192.845141:0:10391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681202816:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201192.845343:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472011f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845351:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472011f expref: 23 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201192.845360:0:10391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681202944:0@lo:104: 00000100:00100000:3.0:1788201192.845472:0:10391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201192.845517:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845526:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 23 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201192.845535:0:10391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681203072:0@lo:104: 00000100:00100000:3.0:1788201192.845636:0:10391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201192.845656:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845664:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 23 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201192.845672:0:10391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681203200:0@lo:104: 00010000:00010000:3.0:1788201192.845710:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75600/0xf9b71aee4471ff9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.845722:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a75600/0xf9b71aee4471ff9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 23 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201192.845731:0:10391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83362d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681203328:0@lo:104: 00000100:00100000:3.0:1788201192.845978:0:10391:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba266cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201192.847150:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201192.847196:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201192.847218:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201192.847229:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681202944 00000100:00100000:0.0:1788201192.847237:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681202944 00000100:00100000:0.0:1788201192.847286:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681203072 00000100:00100000:0.0:1788201192.847288:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681203072 00000100:00100000:0.0:1788201192.847299:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681203200 00000100:00100000:0.0:1788201192.847301:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681203200 00000100:00100000:0.0:1788201192.847310:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681203328 00000100:00100000:0.0:1788201192.847313:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681203328 00000100:00100000:0.0:1788201192.847327:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201192.847335:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:10391:x1875064681202944:12345-0@lo:104: 00010000:00010000:0.0:1788201192.847366:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.847674:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201192.847682:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:10391:x1875064681202944:12345-0@lo:104: Request processed in 347us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201192.847690:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788201192.847701:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201192.847710:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201192.847714:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788201192.847719:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081671c00 already unused, calling callback (ffffffffc1519c20) 00000100:00100000:0.0:1788201192.847720:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:10391:x1875064681203072:12345-0@lo:104: 10000000:00010000:1.0:1788201192.847723:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.847728:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847733:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201192.847776:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201192.847782:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201192.847792:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201192.847797:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:10391:x1875064681203072:12345-0@lo:104: Request processed in 78us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201192.847802:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788201192.847819:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847825:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201192.847833:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201192.847839:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:10391:x1875064681203200:12345-0@lo:104: 00010000:00010000:0.0:1788201192.847845:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847847:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847854:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081671c00/0xf9b71aee4472011f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720126 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847865:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201192.847869:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847875:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1a00 already unused, calling callback (ffffffffc1519c20) 00010000:00010000:0.0:1788201192.847875:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1788201192.847877:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201192.847879:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:10391:x1875064681203200:12345-0@lo:104: Request processed in 41us (686us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201192.847885:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201192.847885:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 10000000:00010000:1.0:1788201192.847891:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201192.847896:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788201192.847897:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201192.847902:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:10391:x1875064681203328:12345-0@lo:104: 00010000:00010000:1.0:1788201192.847915:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.847915:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847921:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201192.847938:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.847941:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788201192.847944:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee4471fff9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720000 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201192.847946:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:10391:x1875064681203328:12345-0@lo:104: Request processed in 44us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201192.847952:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788201192.847955:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201192.847957:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847963:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081671600 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201192.847965:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847971:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.847973:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201192.847977:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201192.847978:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201192.847983:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201192.847984:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081670000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201192.847987:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.847993:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.847994:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.848000:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1788201192.848000:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.848005:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201192.848006:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201192.848017:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.848021:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081671600/0xf9b71aee4471ffa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ffac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848022:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201192.848028:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.848030:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201192.848032:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201192.848033:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201192.848034:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081670000/0xf9b71aee4471ff97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4471ff9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848052:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201192.848053:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201192.848055:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201192.848058:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681203840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201192.848060:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201192.848097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201192.848127:0:10391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681202944:0@lo:104: 00000100:00100000:3.0:1788201192.848137:0:10391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681203072:0@lo:104: 00000100:00100000:1.0:1788201192.848142:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201192.848143:0:10391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681203200:0@lo:104: 00000100:00100000:1.0:1788201192.848147:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681203456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201192.848149:0:10391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83362d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681203328:0@lo:104: 00000100:00100000:1.0:1788201192.848168:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201192.848195:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681203584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201192.848211:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681203840 00000100:00100000:1.0:1788201192.848216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201192.848216:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681203840 00000100:00100000:1.0:1788201192.848231:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201192.848235:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681203712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201192.848237:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75600/0xf9b71aee4471ff9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 24 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201192.848256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201192.848261:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681203456 00000100:00100000:0.0:1788201192.848263:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681203456 00010000:00010000:0.0:1788201192.848273:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472011f expref: 25 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201192.848277:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681203584 00000100:00100000:1.0:1788201192.848279:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681203584 00000100:00100000:0.0:1788201192.848285:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681203712 00000100:00100000:0.0:1788201192.848287:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681203712 00010000:00010000:0.0:1788201192.848294:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 27 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201192.848308:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201192.848313:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+27:3644:x1875064681203840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201192.848325:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201192.848332:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75600/0xf9b71aee4471ff9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 27 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848341:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75600/0xf9b71aee4471ff9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 27 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848358:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75600/0xf9b71aee4471ff9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ff97 expref: 27 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848378:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201192.848418:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+26:3644:x1875064681203840:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201192.848424:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201192.848439:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201192.848444:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+25:3644:x1875064681203456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201192.848451:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201192.848455:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472011f expref: 25 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848462:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472011f expref: 25 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848471:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44720126 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472011f expref: 25 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848489:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201192.848510:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681203456:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201192.848515:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201192.848529:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201192.848534:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:3646:x1875064681203712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201192.848551:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201192.848555:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 23 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848562:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 23 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848577:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75200/0xf9b71aee4471ffac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471ffa5 expref: 23 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.848584:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201192.848611:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3646:x1875064681203712:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201192.848616:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201192.848646:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681203712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201192.848668:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681203456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201192.848674:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681203840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201192.849409:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 21 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201192.849453:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201192.849465:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3646:x1875064681203584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201192.849476:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201192.849482:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 21 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.849505:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 21 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.849517:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081671e00/0xf9b71aee44720000 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4471fff9 expref: 21 pid: 6510 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.849527:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201192.849580:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:3646:x1875064681203584:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201192.849624:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681203584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201192.849649:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201192.852838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201192.852899:0:10391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875064681202816:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201192.852941:0:10391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201192.853252:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662268160 00000100:00100000:1.0:1788201192.853261:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662268160 00010000:00010000:1.0:1788201192.853316:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 10 pid: 6510 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201192.853357:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:1.0:1788201192.853368:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83362300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2398:x1875064662268160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201192.853388:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201192.853395:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 10 pid: 6510 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853406:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 10 pid: 6510 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853427:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1e00/0xf9b71aee4472023e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef9 expref: 10 pid: 6510 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853443:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853471:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853492:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853498:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853504:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853510:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853515:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201192.853519:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853527:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853546:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.853556:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201192.853634:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83362300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:2398:x1875064662268160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 267us (809us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201192.853640:0:10391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201192.853642:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00010000:00010000:0.0:1788201192.853648:0:10391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201192.853653:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44720302 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.654594:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788201193.912770:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201193.912781:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cdf81977800 from 4 10000000:01000000:2.0:1788201193.912789:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201193.912864:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.912879:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.912893:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201193.912924:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681203968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.913009:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.913069:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0855a8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201193.915377:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681203968 00000100:00100000:1.0:1788201193.915395:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681203968 00000100:00100000:1.0:1788201193.915487:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788201193.915499:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681203968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201193.915522:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201193.915546:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720309 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.915580:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720309 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.915593:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720309 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.915604:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255200, rc 0) 00000100:00100000:1.0:1788201193.915705:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681203968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.915712:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788201193.915927:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681203968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201193.915949:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.915959:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201193.916073:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.916111:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.916151:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0855a8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201193.916184:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681204096 00000100:00100000:2.0:1788201193.916188:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681204096 00000100:00100000:2.0:1788201193.916223:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788201193.916231:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681204096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.916371:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681204096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.916379:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788201193.916413:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.916440:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.916484:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.916507:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0855a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201193.916594:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681204224 00000100:00100000:0.0:1788201193.916599:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681204224 00000100:00100000:0.0:1788201193.916643:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788201193.916650:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681204224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201193.916769:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681204224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201193.916777:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788201193.916998:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.917641:0:10416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10416:1875064681204352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201193.917698:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201193.917766:0:10416:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201193.917826:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681204352 00000100:00100000:0.0:1788201193.917833:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681204352 00000100:00100000:0.0:1788201193.917875:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788201193.917882:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:10416:x1875064681204352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201193.917997:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:10416:x1875064681204352:12345-0@lo:502:llog_process_th.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201193.918005:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788201193.918116:0:10416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10416:1875064681204352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201193.918145:0:10416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201193.918158:0:10416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201193.918162:0:10416:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201193.918170:0:10416:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cdf81977800 00000020:00000080:2.0:1788201193.918173:0:10416:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201193.918331:0:10416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10416:1875064681204480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201193.918438:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.918536:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681204480 00000100:00100000:2.0:1788201193.918541:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681204480 00000100:00100000:2.0:1788201193.918567:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788201193.918575:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:10416:x1875064681204480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201193.918651:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:10416:x1875064681204480:12345-0@lo:502:llog_process_th.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.918659:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788201193.918693:0:10416:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201193.918706:0:10416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10416:1875064681204480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201193.918724:0:10416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201193.918729:0:10416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201193.918731:0:10416:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201193.918735:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788201193.918831:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788201193.918850:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201193.918861:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.918874:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201193.918886:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201193.918889:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b95bd800 from 4 10000000:01000000:2.0:1788201193.918893:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201193.918920:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.918929:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.918951:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201193.918966:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.918994:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.919012:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201193.919024:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681204608 00000100:00100000:2.0:1788201193.919027:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681204608 00000100:00100000:2.0:1788201193.919045:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788201193.919050:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681204608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201193.919059:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201193.919072:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720317 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.919096:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720317 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.919107:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720317 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.919117:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0e00, rc 0) 00000100:00100000:2.0:1788201193.919144:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681204608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.919151:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788201193.919178:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201193.919191:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.919207:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201193.920912:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.920976:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.921026:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201193.921379:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681204736 00000100:00100000:1.0:1788201193.921387:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681204736 00000100:00100000:1.0:1788201193.921433:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788201193.921443:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681204736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.921596:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681204736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.921604:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788201193.921696:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.921771:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.921814:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201193.921830:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201193.921844:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681204864 00000100:00100000:1.0:1788201193.921847:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681204864 00000100:00100000:1.0:1788201193.921870:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788201193.921876:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681204864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.921958:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681204864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.921964:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788201193.922004:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681204864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.922209:0:10417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10417:1875064681204992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201193.923895:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201193.923983:0:10417:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0945749c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201193.935706:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681204992 00000100:00100000:3.0:1788201193.935724:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681204992 00000100:00100000:3.0:1788201193.936160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788201193.936172:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:10417:x1875064681204992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201193.937781:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:10417:x1875064681204992:12345-0@lo:502:llog_process_th.0 Request processed in 1602us (13885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201193.937796:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788201193.940140:0:10417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10417:1875064681204992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201193.940199:0:10417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201193.940211:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201193.940214:0:10417:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788201193.940223:0:10417:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0b95bd800 00000020:00000080:1.0:1788201193.940347:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788201193.940471:0:10417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10417:1875064681205120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201193.940559:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201193.940604:0:10417:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0945749c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201193.940626:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681205120 00000100:00100000:1.0:1788201193.940640:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681205120 00000100:00100000:1.0:1788201193.940702:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788201193.940712:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:10417:x1875064681205120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201193.940866:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:10417:x1875064681205120:12345-0@lo:502:llog_process_th.0 Request processed in 155us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.940875:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788201193.940922:0:10417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10417:1875064681205120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201193.940942:0:10417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201193.940947:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201193.940949:0:10417:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788201193.940953:0:10417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788201193.941088:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788201193.941112:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201193.941123:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.941137:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201193.941150:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201193.941153:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce09e1da800 from 4 10000000:01000000:1.0:1788201193.941156:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201193.941183:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.941192:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.941203:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201193.944353:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681205248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.944513:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201193.944571:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0945749c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201193.944806:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681205248 00000100:00100000:2.0:1788201193.944817:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681205248 00000100:00100000:2.0:1788201193.944877:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788201193.944888:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681205248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201193.944909:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201193.944931:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720325 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.944968:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720325 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.944981:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720325 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.944991:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1a00, rc 0) 00000100:00100000:2.0:1788201193.945046:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681205248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.945052:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788201193.951830:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681205248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201193.951868:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.951894:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201193.952001:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681205376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.952077:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.952127:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201193.952152:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681205376 00000100:00100000:2.0:1788201193.952159:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681205376 00000100:00100000:2.0:1788201193.952211:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788201193.952222:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681205376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.954679:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681205376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2452us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.954692:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788201193.954805:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681205376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.954867:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681205504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.954919:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.954957:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201193.954975:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681205504 00000100:00100000:2.0:1788201193.954982:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681205504 00000100:00100000:2.0:1788201193.955023:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788201193.955032:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681205504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.955112:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681205504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.955119:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788201193.955164:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681205504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.968101:0:10420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10420:1875064681205632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201193.968205:0:10420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.968434:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681205632 00000100:00100000:2.0:1788201193.968442:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681205632 00000100:00100000:2.0:1788201193.968502:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788201193.968512:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:10420:x1875064681205632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201193.968651:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:10420:x1875064681205632:12345-0@lo:502:llog_process_th.0 Request processed in 140us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.968659:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788201193.968719:0:10420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201193.968780:0:10420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10420:1875064681205632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201193.968815:0:10420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201193.968827:0:10420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201193.968830:0:10420:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201193.968839:0:10420:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce09e1da800 00000020:00000080:2.0:1788201193.968841:0:10420:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201193.971616:0:10420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10420:1875064681205760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201193.971723:0:10420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.971794:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681205760 00000100:00100000:2.0:1788201193.971802:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681205760 00000100:00100000:2.0:1788201193.971856:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788201193.971866:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:10420:x1875064681205760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201193.972003:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:10420:x1875064681205760:12345-0@lo:502:llog_process_th.0 Request processed in 137us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.972011:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788201193.972079:0:10420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201193.972105:0:10420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10420:1875064681205760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201193.972139:0:10420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201193.972148:0:10420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201193.972150:0:10420:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201193.972157:0:10420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788201193.975103:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788201193.975148:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201193.975161:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.975179:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201193.975192:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201193.975195:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0889be000 from 4 10000000:01000000:2.0:1788201193.975198:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201193.976477:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.976494:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201193.976509:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201193.976541:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681205888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201193.976631:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.976684:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201193.978009:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681205888 00000100:00100000:1.0:1788201193.978021:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681205888 00000100:00100000:1.0:1788201193.978087:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788201193.978099:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681205888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201193.978117:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201193.978135:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720333 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.978166:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720333 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.978178:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720333 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.978188:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254e00, rc 0) 00000100:00100000:1.0:1788201193.978441:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681205888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.978449:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788201193.978514:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681205888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201193.978533:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.978544:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201193.978636:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681206016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.978669:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201193.978701:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201193.978716:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681206016 00000100:00100000:1.0:1788201193.978719:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681206016 00000100:00100000:1.0:1788201193.978779:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788201193.978786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681206016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.978913:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681206016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.978920:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788201193.978952:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681206016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.978979:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681206144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.979019:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201193.979032:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201193.979043:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681206144 00000100:00100000:1.0:1788201193.979046:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681206144 00000100:00100000:1.0:1788201193.979063:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788201193.979068:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681206144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201193.979141:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681206144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.979148:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788201193.979184:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681206144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201193.982677:0:10422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83363100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10422:1875064681206272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201193.982812:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201193.982859:0:10422:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba266cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201193.983447:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681206272 00000100:00100000:1.0:1788201193.983464:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681206272 00000100:00100000:1.0:1788201193.983526:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788201193.983537:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:10422:x1875064681206272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201193.983690:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:10422:x1875064681206272:12345-0@lo:502:llog_process_th.0 Request processed in 154us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.983698:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788201193.983846:0:10422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83363100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10422:1875064681206272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201193.983884:0:10422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201193.983897:0:10422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201193.983900:0:10422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201193.983919:0:10422:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0889be000 00000020:00000080:3.0:1788201193.983922:0:10422:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201193.984014:0:10422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83363100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10422:1875064681206400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201193.984057:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201193.984072:0:10422:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201193.987073:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681206400 00000100:00100000:0.0:1788201193.987091:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681206400 00000100:00100000:0.0:1788201193.987153:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788201193.987165:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:10422:x1875064681206400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201193.988952:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:10422:x1875064681206400:12345-0@lo:502:llog_process_th.0 Request processed in 1776us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201193.988968:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788201193.990503:0:10422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83363100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:10422:1875064681206400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201193.990557:0:10422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201193.990566:0:10422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201193.990569:0:10422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201193.990575:0:10422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788201193.993029:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788201193.993072:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201193.993086:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201193.993102:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201194.570388:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201194.570426:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662268288 00000100:00100000:3.0:1788201194.570436:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662268288 00000100:00100000:3.0:1788201194.570493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 269 00000100:00100000:3.0:1788201194.570504:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+9:6171:x1875064662268288:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201194.570522:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201194.570541:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbf3f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201194.570571:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201194.570584:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201194.570593:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbe00, rc 0) 00000100:00100000:3.0:1788201194.570648:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6171:x1875064662268288:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 146us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201194.570655:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 269 00000100:00100000:3.0:1788201194.578029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201194.578107:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662268416 00000100:00100000:0.0:1788201194.578123:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662268416 00000100:00100000:0.0:1788201194.578200:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 270 00000100:00100000:0.0:1788201194.578211:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6171:x1875064662268416:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201194.578380:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6171:x1875064662268416:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 170us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201194.578388:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 270 00000100:00100000:3.0:1788201194.580376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201194.586884:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662268544 00000100:00100000:0.0:1788201194.586900:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662268544 00000100:00100000:0.0:1788201194.592236:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 271 00000100:00100000:0.0:1788201194.592708:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6171:x1875064662268544:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201194.592887:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6171:x1875064662268544:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 193us (12524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201194.592896:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 271 00000100:00100000:0.0:1788201194.606494:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201194.606798:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662268672 00000100:00100000:1.0:1788201194.606809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662268672 00000100:00100000:1.0:1788201194.606868:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 272 00000100:00100000:1.0:1788201194.606880:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6716:x1875064662268672:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201194.607045:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6716:x1875064662268672:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 166us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201194.607055:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 272 00000100:00100000:3.0:1788201194.611898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201194.612001:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662268800 00000100:00100000:1.0:1788201194.612017:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662268800 00000100:00100000:1.0:1788201194.612089:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 273 00000100:00100000:1.0:1788201194.612103:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6716:x1875064662268800:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201194.612290:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:6716:x1875064662268800:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201194.612312:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 273 00010000:00010000:2.0:1788201194.685143:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201195.126009:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681206912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126188:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681207424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126241:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681207936:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126262:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126292:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788201195.126298:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681206528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126349:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681207040:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126393:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681207552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126421:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126443:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681208064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201195.126444:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681206784:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126469:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201195.126494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126503:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681206656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126573:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681207168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126610:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681207680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681206912 00000100:00100000:0.0:1788201195.126671:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681206912 00000100:00100000:0.0:1788201195.126716:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681206656 00000100:00100000:0.0:1788201195.126719:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681206656 00000100:00100000:0.0:1788201195.126768:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681207168 00000100:00100000:0.0:1788201195.126771:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681207168 00000100:00100000:0.0:1788201195.126796:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681207680 00000100:00100000:0.0:1788201195.126799:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681207680 00000100:00100000:0.0:1788201195.126815:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201195.126825:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681206912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126888:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681206912:12345-0@lo:400:kworker.0 Request processed in 64us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201195.126890:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681207296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201195.126927:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201195.126930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126937:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681206656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201195.126947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681207808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.126984:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681206656:12345-0@lo:400:kworker.0 Request processed in 46us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201195.126985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.126995:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788201195.127010:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681207296 00000100:00100000:0.0:1788201195.127013:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681207296 00000100:00100000:1.0:1788201195.127024:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681207424 00000100:00100000:1.0:1788201195.127031:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681207424 00000100:00100000:0.0:1788201195.127031:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681207808 00000100:00100000:0.0:1788201195.127037:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681207808 00000100:00100000:0.0:1788201195.127060:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201195.127068:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681207936 00000100:00100000:1.0:1788201195.127073:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681207936 00000100:00100000:0.0:1788201195.127076:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681207168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201195.127090:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681207552 00000100:00100000:0.0:1788201195.127112:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681207168:12345-0@lo:400:kworker.0 Request processed in 39us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127118:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201195.127131:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201195.127137:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681207680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127176:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681207680:12345-0@lo:400:kworker.0 Request processed in 39us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127182:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201195.127194:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201195.127200:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681207296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127231:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681207296:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127237:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201195.127248:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201195.127254:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681207808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127277:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681207808:12345-0@lo:400:kworker.0 Request processed in 24us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127283:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201195.127301:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681208064 00000100:00100000:0.0:1788201195.127305:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681208064 00000100:00100000:0.0:1788201195.127321:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201195.127327:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681207424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127356:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681207424:12345-0@lo:400:kworker.0 Request processed in 29us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127372:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201195.127391:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201195.127397:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681207936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127426:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681207936:12345-0@lo:400:kworker.0 Request processed in 30us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127431:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201195.127441:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201195.127446:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681208064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127467:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681208064:12345-0@lo:400:kworker.0 Request processed in 21us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127472:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201195.127490:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681206528 00000100:00100000:0.0:1788201195.127493:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681206528 00000100:00100000:0.0:1788201195.127520:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788201195.127526:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681206528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127552:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681206528:12345-0@lo:400:kworker.0 Request processed in 27us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127557:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788201195.127584:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681207040 00000100:00100000:0.0:1788201195.127587:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681207040 00000100:00100000:0.0:1788201195.127607:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681206784 00000100:00100000:0.0:1788201195.127609:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681206784 00000100:00100000:0.0:1788201195.127620:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201195.127625:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681207040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127654:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681207040:12345-0@lo:400:kworker.0 Request processed in 28us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127666:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201195.127676:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201195.127681:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681206784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127704:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681206784:12345-0@lo:400:kworker.0 Request processed in 24us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.127709:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788201195.127761:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201195.127765:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201195.127768:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201195.127770:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201195.127820:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681206656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127832:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681207168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127841:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681207680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127874:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681206528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127884:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681207040:0@lo:400:kworker.0 00010000:00080000:0.0:1788201195.127896:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834cf800 x1875064681208064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201195.127907:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681208064:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.127920:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681206912:0@lo:400:kworker.0 00010000:00080000:0.0:1788201195.127929:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50fb80 x1875064681207424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201195.127936:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681207424:0@lo:400:kworker.0 00010000:00080000:0.0:1788201195.127954:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834cfb80 x1875064681207936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201195.127961:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681207936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201195.128179:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681207552 00000100:00100000:1.0:1788201195.128230:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201195.128239:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681207552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201195.128287:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681207552:12345-0@lo:400:kworker.0 Request processed in 49us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201195.128294:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201195.128344:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681206784:0@lo:400:kworker.0 00010000:00080000:1.0:1788201195.128356:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50d180 x1875064681207296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201195.128365:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681207296:0@lo:400:kworker.0 00010000:00080000:1.0:1788201195.128376:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834cd500 x1875064681207808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201195.128397:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681207808:0@lo:400:kworker.0 00010000:00080000:1.0:1788201195.128428:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834cdc00 x1875064681207552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201195.128437:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681207552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.129036:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681208192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201195.129093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201195.129492:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201195.130701:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681208192 00000100:00100000:1.0:1788201195.130716:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681208192 00000100:00100000:1.0:1788201195.132870:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201195.132894:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681208192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201195.132937:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201195.133056:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681208192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (3962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201195.133065:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788201195.134909:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83363800 x1875064681208192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201195.134938:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681208192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201195.204310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201195.204368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201195.204445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201195.204489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201195.204551:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662268928 00000100:00100000:0.0:1788201195.204564:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662268928 00000100:00100000:0.0:1788201195.204636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662269056 00000100:00100000:0.0:1788201195.204640:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662269056 00000100:00100000:0.0:1788201195.204668:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:0.0:1788201195.204681:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662268928:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201195.204811:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662268928:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 133us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.204820:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:0.0:1788201195.204838:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:0.0:1788201195.204844:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269056:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201195.204869:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269056:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.204875:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00080000:0.0:1788201195.204894:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201195.204909:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201195.208021:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662269184 00000100:00100000:1.0:1788201195.208039:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662269184 00000100:00100000:1.0:1788201195.208157:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662269312 00000100:00100000:1.0:1788201195.208161:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662269312 00000100:00080000:2.0:1788201195.208199:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201195.208204:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201195.208408:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:0.0:1788201195.208422:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269184:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201195.208664:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269184:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 245us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.208673:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:0.0:1788201195.208694:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:0.0:1788201195.208702:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269312:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201195.208757:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269312:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.208764:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:0.0:1788201195.639284:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201195.639314:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681208320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201195.639400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201195.639842:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681208320 00000100:00100000:1.0:1788201195.639851:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681208320 00000100:00100000:1.0:1788201195.639913:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201195.639923:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681208320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201195.639955:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201195.640024:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681208320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201195.640032:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788201195.640076:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83361500 x1875064681208320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201195.640104:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681208320:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201195.702056:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201196.740051:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201197.173956:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201197.173982:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681208448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201197.174057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201197.174134:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681208448 00000100:00100000:2.0:1788201197.174142:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681208448 00000100:00100000:2.0:1788201197.174189:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201197.174198:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681208448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201197.174234:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201197.174282:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681208448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201197.174290:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201197.174341:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681208448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201197.180830:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201197.180854:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681208576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201197.180921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201197.180980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681208576 00000100:00100000:1.0:1788201197.180986:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681208576 00000100:00100000:1.0:1788201197.181029:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201197.181037:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681208576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201197.181070:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201197.181114:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681208576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201197.181121:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201197.181162:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681208576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201197.686218:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681208704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201197.686292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201197.686880:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681208704 00000100:00100000:0.0:1788201197.686889:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681208704 00000100:00100000:0.0:1788201197.686949:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201197.686961:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681208704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201197.686992:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788201197.687069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201197.696192:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681208704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9223us (9889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201197.696207:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788201197.699110:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83363480 x1875064681208704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201197.699144:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681208704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201197.699170:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201197.699181:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681208832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201197.699497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201197.699588:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681208832 00000100:00100000:1.0:1788201197.699595:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681208832 00000100:00100000:1.0:1788201197.699651:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201197.699660:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681208832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201197.699683:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201197.699763:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681208832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201197.699771:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788201197.699790:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201197.699811:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83362a00 x1875064681208832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201197.699827:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681208832:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788201197.752535:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201198.775153:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201199.551348:0:10691:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788201199.809246:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201200.246065:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681208960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201200.246160:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.246324:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681208960 00000100:00100000:3.0:1788201200.246334:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681208960 00000100:00100000:3.0:1788201200.246407:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201200.246420:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681208960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201200.246461:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201200.246517:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681208960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.246524:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788201200.246568:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83363b80 x1875064681208960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201200.246603:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681208960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201200.246629:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681209472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.246645:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681209216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.246657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.246673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.246676:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681209984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.246707:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681209728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.246715:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.246730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.246732:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681210496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.246763:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681210240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.246769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.246791:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201200.246797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.246798:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681209088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.246825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.246828:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201200.246844:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681209344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.246845:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681209600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.246865:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681209472 00000100:00100000:2.0:1788201200.246871:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681209472 00000100:00100000:1.0:1788201200.246872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.246880:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681209216 00000100:00100000:3.0:1788201200.246884:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681209216 00000100:00100000:1.0:1788201200.246899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681209856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.246903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681209728 00000100:00100000:2.0:1788201200.246907:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681209728 00000100:00100000:3.0:1788201200.246918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681210240 00000100:00100000:1.0:1788201200.246923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.246924:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681210240 00000100:00100000:2.0:1788201200.246932:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681209856 00000100:00100000:1.0:1788201200.246938:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681210368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.246945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681209856 00000100:00100000:3.0:1788201200.246950:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788201200.246958:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681209472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.246964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.246975:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681210368 00000100:00100000:2.0:1788201200.246979:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681210368 00000100:00100000:2.0:1788201200.247007:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201200.247008:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681209472:12345-0@lo:400:kworker.0 Request processed in 46us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.247016:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681209216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201200.247055:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201200.247062:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201200.247066:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681209216:12345-0@lo:400:kworker.0 Request processed in 50us (390us total) trans 0 rc 0/0 00000100:00080000:0.0:1788201200.247071:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201200.247369:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201200.247380:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681209728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.247415:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681209728:12345-0@lo:400:kworker.0 Request processed in 39us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.247421:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201200.247435:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201200.247439:0:8476:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788201200.247449:0:8476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788201200.247457:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201200.247474:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681210240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.247480:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681209984 00000100:00100000:1.0:1788201200.247485:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681209984 00000100:00100000:2.0:1788201200.247514:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681210240:12345-0@lo:400:kworker.0 Request processed in 42us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.247521:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201200.247524:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681210496 00000100:00100000:1.0:1788201200.247528:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681210496 00000100:00100000:2.0:1788201200.247539:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201200.247548:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681209856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.247556:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201200.247565:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681209984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.247582:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681209856:12345-0@lo:400:kworker.0 Request processed in 36us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.247589:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201200.247605:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788201200.247611:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681209984:12345-0@lo:400:kworker.0 Request processed in 48us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.247616:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681210368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.247625:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201200.247673:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681210368:12345-0@lo:400:kworker.0 Request processed in 60us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.247681:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201200.248006:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201200.248018:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681210496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.248066:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681210496:12345-0@lo:400:kworker.0 Request processed in 50us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.248084:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201200.248105:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681209088 00000100:00100000:1.0:1788201200.248111:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681209088 00000100:00100000:1.0:1788201200.248150:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788201200.248156:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681209088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.248188:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681209088:12345-0@lo:400:kworker.0 Request processed in 32us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.248194:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788201200.248218:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681209344 00000100:00100000:1.0:1788201200.248222:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681209344 00000100:00100000:1.0:1788201200.248244:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201200.248250:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681209344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.248281:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681209344:12345-0@lo:400:kworker.0 Request processed in 30us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.248294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788201200.248320:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201200.248324:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201200.248351:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681209344:0@lo:400:kworker.0 00010000:00080000:1.0:1788201200.248364:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0700 x1875064681209856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201200.248374:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681209856:0@lo:400:kworker.0 00010000:00080000:1.0:1788201200.248383:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fc380 x1875064681210368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201200.248391:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681210368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.248402:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681209216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.248411:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681209728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.248420:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681210240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.248458:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788201200.248489:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.248577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681210112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.248609:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.248648:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681209472:0@lo:400:kworker.0 00010000:00080000:3.0:1788201200.248663:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b2680 x1875064681209984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201200.248673:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681209984:0@lo:400:kworker.0 00010000:00080000:3.0:1788201200.248684:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fc000 x1875064681210496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201200.248706:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681210496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.248723:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681210112 00000100:00100000:2.0:1788201200.248728:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681210112 00000100:00100000:3.0:1788201200.248733:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681209088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.248808:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201200.248814:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681210112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.248849:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681210112:12345-0@lo:400:kworker.0 Request processed in 36us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.248854:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788201200.248861:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0380 x1875064681210112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201200.248872:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681210112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.248927:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681209600 00000100:00100000:1.0:1788201200.248932:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681209600 00000100:00100000:1.0:1788201200.248964:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201200.248972:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681209600:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201200.248975:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201200.249107:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681209600:12345-0@lo:400:kworker.0 Request processed in 135us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.249114:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201200.249384:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681209600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201200.321527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201200.321574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201200.321604:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201200.321666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662269440 00000100:00100000:3.0:1788201200.321684:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662269440 00000100:00100000:3.0:1788201200.321776:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 276 00000100:00100000:3.0:1788201200.321788:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2400:x1875064662269440:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201200.321889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2400:x1875064662269440:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 103us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.321898:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 276 00000100:00100000:3.0:1788201200.328201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662269568 00000100:00100000:3.0:1788201200.328220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662269568 00000100:00100000:3.0:1788201200.328341:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:3.0:1788201200.328354:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2401:x1875064662269568:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201200.328464:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2401:x1875064662269568:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 112us (6888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.328473:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00080000:3.0:1788201200.328505:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201200.329628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201200.329735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201200.329793:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662269824 00000100:00100000:0.0:1788201200.329800:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662269824 00000100:00100000:0.0:1788201200.329861:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662269952 00000100:00100000:0.0:1788201200.329865:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662269952 00000100:00100000:0.0:1788201200.329891:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:0.0:1788201200.329901:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662269824:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201200.329963:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662269824:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 64us (8358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.329969:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:0.0:1788201200.329985:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:0.0:1788201200.329992:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269952:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201200.330015:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269952:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.330021:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:3.0:1788201200.331574:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662269696 00000100:00100000:3.0:1788201200.331588:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662269696 00000100:00100000:3.0:1788201200.333484:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00100000:3.0:1788201200.333511:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269696:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201200.333610:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662269696:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 111us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.333618:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00080000:3.0:1788201200.335438:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201200.335448:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201200.335451:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201200.758060:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681210624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201200.758137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.758384:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681210624 00000100:00100000:3.0:1788201200.758393:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681210624 00000100:00100000:3.0:1788201200.758458:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201200.758483:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681210624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201200.758521:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201200.758576:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681210624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.758583:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788201200.758781:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83360380 x1875064681210624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201200.758799:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681210624:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201200.822004:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201201.854040:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201202.294645:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201202.294686:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681210752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201202.294810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201202.295170:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201202.295183:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681210880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201202.295216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201202.295252:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681210752 00000100:00100000:0.0:1788201202.295262:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681210752 00000100:00100000:0.0:1788201202.295310:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681210880 00000100:00100000:0.0:1788201202.295314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681210880 00000100:00100000:0.0:1788201202.295330:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201202.295338:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681210752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201202.295381:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788201202.295426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681210752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.295434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201202.295452:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201202.295457:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681210880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201202.295485:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788201202.295529:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681210880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.295535:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201202.295579:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681210880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201202.295886:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681210752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201202.806008:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681211008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201202.806118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.806325:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681211008 00000100:00100000:3.0:1788201202.806337:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681211008 00000100:00100000:3.0:1788201202.806405:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201202.806421:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681211008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201202.806460:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201202.806513:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681211008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201202.806521:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788201202.806545:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201202.806583:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82395880 x1875064681211008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201202.806607:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681211008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201202.806627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201202.806634:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681211136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201202.806658:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.806708:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681211136 00000100:00100000:3.0:1788201202.806712:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681211136 00000100:00100000:3.0:1788201202.806766:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201202.806774:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681211136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201202.806786:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201202.806816:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681211136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201202.806829:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788201202.806844:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201202.806861:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83360000 x1875064681211136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201202.806874:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681211136:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788201202.870969:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201203.894212:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201204.918950:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201205.298572:0:10936:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing yml_node 00000100:00100000:0.0:1788201205.367072:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681211264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201205.367150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368028:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681211776:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368095:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681212288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368140:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681212800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368161:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368182:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201205.368188:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681211392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368239:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681211904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368277:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681212416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368321:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681211520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368344:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368361:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681212032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368401:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681212544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368423:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368442:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201205.368448:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681211648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368478:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681212160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368499:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368529:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681212672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.368585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681211776 00000100:00100000:1.0:1788201205.368591:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681211776 00000100:00100000:1.0:1788201205.368630:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681211520 00000100:00100000:1.0:1788201205.368634:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681211520 00000100:00100000:1.0:1788201205.368651:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201205.368673:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681211776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368730:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681211776:12345-0@lo:400:kworker.0 Request processed in 59us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.368757:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201205.368774:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201205.368781:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681211520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681211520:12345-0@lo:400:kworker.0 Request processed in 34us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.368830:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201205.368847:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681212288 00000100:00100000:1.0:1788201205.368851:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681212288 00000100:00100000:1.0:1788201205.368879:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681212800 00000100:00100000:1.0:1788201205.368883:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681212800 00000100:00100000:1.0:1788201205.368897:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681212160 00000100:00100000:1.0:1788201205.368900:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681212160 00000100:00100000:1.0:1788201205.368914:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681212672 00000100:00100000:1.0:1788201205.368916:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681212672 00000100:00100000:1.0:1788201205.368930:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201205.368937:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681212288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.368969:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681212288:12345-0@lo:400:kworker.0 Request processed in 32us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.368975:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201205.368995:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201205.369002:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681212800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369032:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681212800:12345-0@lo:400:kworker.0 Request processed in 31us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369038:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201205.369048:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201205.369054:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681212160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369080:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681212160:12345-0@lo:400:kworker.0 Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369086:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201205.369096:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201205.369102:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681212672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369128:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681212672:12345-0@lo:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369134:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201205.369155:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681211392 00000100:00100000:1.0:1788201205.369159:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681211392 00000100:00100000:1.0:1788201205.369176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681211904 00000100:00100000:1.0:1788201205.369179:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681211904 00000100:00100000:1.0:1788201205.369192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681212416 00000100:00100000:1.0:1788201205.369195:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681212416 00000100:00100000:1.0:1788201205.369204:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681212032 00000100:00100000:1.0:1788201205.369207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681212032 00000100:00100000:1.0:1788201205.369217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681212544 00000100:00100000:1.0:1788201205.369219:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681212544 00000100:00100000:1.0:1788201205.369230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681211648 00000100:00100000:1.0:1788201205.369232:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681211648 00000100:00100000:1.0:1788201205.369242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201205.369247:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681211392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369284:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681211392:12345-0@lo:400:kworker.0 Request processed in 37us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369290:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201205.369301:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201205.369307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681211904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369332:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681211904:12345-0@lo:400:kworker.0 Request processed in 25us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369338:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201205.369349:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201205.369354:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681212416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369381:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681212416:12345-0@lo:400:kworker.0 Request processed in 27us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369387:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201205.369397:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201205.369403:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681212032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369433:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681212032:12345-0@lo:400:kworker.0 Request processed in 31us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201205.369449:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201205.369455:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681212544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369481:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681212544:12345-0@lo:400:kworker.0 Request processed in 26us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369488:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201205.369498:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201205.369505:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681211648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369540:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681211648:12345-0@lo:400:kworker.0 Request processed in 36us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.369546:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201205.369605:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681211392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369615:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681211904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369624:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681212416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.369634:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681211776:0@lo:400:kworker.0 00010000:00080000:1.0:1788201205.369647:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823aed80 x1875064681212288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.372988:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681212288:0@lo:400:kworker.0 00010000:00080000:1.0:1788201205.373033:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c8e00 x1875064681212800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.373044:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681212800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.373114:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681211648:0@lo:400:kworker.0 00010000:00080000:1.0:1788201205.373129:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823ac380 x1875064681212160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.373139:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681212160:0@lo:400:kworker.0 00010000:00080000:1.0:1788201205.373152:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c8000 x1875064681212672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.373160:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681212672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.373172:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681211520:0@lo:400:kworker.0 00010000:00080000:1.0:1788201205.373197:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823aca80 x1875064681212032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.373207:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681212032:0@lo:400:kworker.0 00010000:00080000:1.0:1788201205.373220:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823adc00 x1875064681212544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.373230:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681212544:0@lo:400:kworker.0 00000100:00080000:1.0:1788201205.373261:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201205.373267:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201205.373271:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201205.373275:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201205.375561:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681211264 00000100:00100000:2.0:1788201205.375575:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681211264 00000100:00100000:2.0:1788201205.375682:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788201205.375693:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681211264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201205.375830:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681211264:12345-0@lo:400:kworker.0 Request processed in 139us (8679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201205.375838:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788201205.377338:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681211264:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.377368:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201205.377380:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681212928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201205.377441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201205.377528:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681212928 00000100:00100000:3.0:1788201205.377536:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681212928 00000100:00100000:3.0:1788201205.377590:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201205.377600:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681212928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201205.377633:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201205.377689:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681212928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201205.377697:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788201205.377785:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83360000 x1875064681212928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.377804:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681212928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201205.442128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201205.442179:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201205.442213:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201205.442246:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662270336 00000100:00100000:3.0:1788201205.442256:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662270336 00000100:00100000:3.0:1788201205.442314:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662270208 00000100:00100000:3.0:1788201205.442317:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662270208 00000100:00100000:3.0:1788201205.442343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:3.0:1788201205.442354:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662270336:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201205.442426:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662270336:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201205.442434:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:3.0:1788201205.442461:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00100000:3.0:1788201205.442468:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2401:x1875064662270208:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201205.442497:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2401:x1875064662270208:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201205.442504:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00080000:3.0:1788201205.442521:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201205.442525:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201205.442688:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662270080 00000100:00100000:1.0:1788201205.442694:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662270080 00000100:00100000:1.0:1788201205.442733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 278 00000100:00100000:1.0:1788201205.442758:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2401:x1875064662270080:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201205.442792:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2401:x1875064662270080:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 36us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.442799:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 278 00000100:00100000:0.0:1788201205.457488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201205.457561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201205.458209:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662270464 00000100:00100000:1.0:1788201205.458219:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662270464 00000100:00080000:0.0:1788201205.458301:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201205.458387:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662270592 00000100:00100000:3.0:1788201205.458391:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662270592 00000100:00100000:3.0:1788201205.458441:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1788201205.458452:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2397:x1875064662270464:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:3.0:1788201205.458489:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720253 00000100:00080000:3.0:1788201205.458498:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ce0a64b8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201205.458543:0:8431:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:0.0:1788201205.458777:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201205.458993:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+2:2397:x1875064662270464:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 540us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201205.459001:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1788201205.459030:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:3.0:1788201205.459038:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2397:x1875064662270592:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:3.0:1788201205.459056:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472025a 00000100:00080000:3.0:1788201205.459062:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201205.459087:0:8431:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788201205.459162:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+2:2397:x1875064662270592:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 125us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201205.459169:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00010000:00010000:3.0:1788201205.459238:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201205.459251:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201205.884367:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681213056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201205.884461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.884545:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681213056 00000100:00100000:1.0:1788201205.884552:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681213056 00000100:00100000:1.0:1788201205.884607:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201205.884616:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681213056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201205.884643:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201205.884704:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681213056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.884711:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788201205.884772:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4eb100 x1875064681213056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.884791:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681213056:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201205.943586:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.966023:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201207.416454:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681213184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201207.416552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201207.416609:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681213184 00000100:00100000:1.0:1788201207.416619:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681213184 00000100:00100000:1.0:1788201207.416693:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201207.416705:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681213184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201207.416783:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201207.416850:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681213184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201207.416859:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201207.417374:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681213184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201207.418414:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201207.418438:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681213312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201207.418505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201207.418712:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681213312 00000100:00100000:1.0:1788201207.418721:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681213312 00000100:00100000:1.0:1788201207.418788:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201207.418798:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681213312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201207.418851:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788201207.418957:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681213312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201207.418965:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201207.419031:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681213312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201207.926490:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201207.926525:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681213440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201207.926616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201207.926677:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681213568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201207.926842:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681213440 00000100:00100000:1.0:1788201207.926852:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681213440 00000100:00100000:3.0:1788201207.926899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201207.926900:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201207.926916:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681213568 00000100:00100000:1.0:1788201207.926921:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681213568 00000100:00100000:2.0:1788201207.926942:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201207.926960:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681213440:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788201207.926986:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788201207.927013:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201207.927064:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681213440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201207.927072:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201207.927099:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788201207.927106:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83360000 x1875064681213440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201207.927108:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681213568:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201207.927132:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681213440:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201207.927237:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201207.927331:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681213568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 225us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201207.927338:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788201207.931576:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b1f80 x1875064681213568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201207.931613:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681213568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201207.991861:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.014009:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201209.830687:0:11119:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.54 00010000:00010000:3.0:1788201210.044932:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201210.486405:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201210.486437:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681213824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201210.486588:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201210.486677:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681214080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.486707:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681214208:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.486709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201210.486721:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681213824 00000100:00100000:1.0:1788201210.486733:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681213824 00000100:00100000:3.0:1788201210.486766:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681214592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.486782:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201210.486805:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681214080 00000100:00100000:3.0:1788201210.486810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681214080 00000100:00100000:2.0:1788201210.486820:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681214720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.486855:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201210.486862:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201210.486867:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681214080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201210.486879:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681213824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201210.486888:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201210.486888:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201210.486917:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681215232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.486943:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681214080:12345-0@lo:400:kworker.0 Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.486951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.486994:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681213696:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.487001:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201210.487034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201210.487035:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681214720 00000100:00100000:3.0:1788201210.487040:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681214720 00000100:00100000:2.0:1788201210.487063:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681214336:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.487078:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681215232 00000100:00100000:3.0:1788201210.487082:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681215232 00000100:00100000:2.0:1788201210.487090:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201210.487110:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201210.487112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681214848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.487120:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681214720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.487153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201210.487172:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681214848 00000100:00100000:3.0:1788201210.487174:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681214720:12345-0@lo:400:kworker.0 Request processed in 56us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.487175:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681215360:0@lo:400:kworker.0 00000100:00100000:0.0:1788201210.487177:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681214848 00000100:00100000:3.0:1788201210.487183:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201210.487197:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201210.487208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201210.487219:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681215232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.487227:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201210.487235:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681213952:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.487265:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681215232:12345-0@lo:400:kworker.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.487273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.487295:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681214464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201210.487317:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201210.487318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788201210.487332:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201210.487332:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681214848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.487345:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681214976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.487438:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201210.487450:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681215360 00000100:00100000:3.0:1788201210.487607:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681215360 00000100:00100000:3.0:1788201210.487638:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201210.487644:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681215360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201210.490169:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681213824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3283us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.490185:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201210.490253:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681214336 00000100:00100000:1.0:1788201210.490262:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681214336 00000100:00100000:1.0:1788201210.490322:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201210.490328:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681214848:12345-0@lo:400:kworker.0 Request processed in 2997us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.490338:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681214336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201210.490343:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201210.490396:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681215360:12345-0@lo:400:kworker.0 Request processed in 2748us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.490407:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201210.490420:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681214336:12345-0@lo:400:kworker.0 Request processed in 85us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.490428:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201210.490449:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681214208 00000100:00100000:3.0:1788201210.490454:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681214208 00000100:00100000:3.0:1788201210.490487:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681213952 00000100:00100000:3.0:1788201210.490490:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681213952 00000100:00100000:3.0:1788201210.490520:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681214464 00000100:00100000:3.0:1788201210.490542:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681214464 00000100:00100000:1.0:1788201210.490566:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201210.490577:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681214208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201210.490633:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681214208:12345-0@lo:400:kworker.0 Request processed in 48us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.491224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.491272:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681214976 00000100:00100000:2.0:1788201210.491276:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681214976 00000100:00100000:0.0:1788201210.491859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201210.491870:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201210.491876:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681213952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.491892:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681214464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201210.492223:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201210.492269:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201210.492289:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681214976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201210.492434:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681213952:12345-0@lo:400:kworker.0 Request processed in 564us (5163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.492437:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681214464:12345-0@lo:400:kworker.0 Request processed in 549us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.492448:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201210.492455:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788201210.492486:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201210.492493:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201210.492496:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201210.492514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201210.492568:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681215104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.492606:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788201210.492661:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83362a00 x1875064681213824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201210.492674:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681214592 00000100:00100000:0.0:1788201210.492682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681214592 00000100:00100000:3.0:1788201210.492688:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681213824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201210.492723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681215104 00000100:00100000:0.0:1788201210.492727:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681215104 00000100:00100000:3.0:1788201210.492729:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681214080:0@lo:400:kworker.0 00000100:00100000:0.0:1788201210.492768:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201210.492777:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681214592:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788201210.492781:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201210.492795:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201210.492808:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681215104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201210.492845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681214592:12345-0@lo:400:kworker.0 Request processed in 69us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.492853:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681215104:12345-0@lo:400:kworker.0 Request processed in 48us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.492854:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201210.492864:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1788201210.492894:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c2300 x1875064681214592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201210.492908:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681214592:0@lo:400:kworker.0 00010000:00080000:3.0:1788201210.492925:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c1500 x1875064681215104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201210.492933:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681215104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.493505:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681214336:0@lo:400:kworker.0 00010000:00080000:3.0:1788201210.493520:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c3800 x1875064681214848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201210.493538:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681214848:0@lo:400:kworker.0 00010000:00080000:3.0:1788201210.493550:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c2a00 x1875064681215360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201210.493559:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681215360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.493584:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681213952:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.493596:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681214464:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.496627:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681214976:12345-0@lo:400:kworker.0 Request processed in 4326us (5382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.496648:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201210.496714:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681213696 00000100:00100000:2.0:1788201210.496724:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681213696 00000100:00100000:2.0:1788201210.496798:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788201210.496807:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681213696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.496862:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681213696:12345-0@lo:400:kworker.0 Request processed in 56us (9830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.496869:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788201210.496940:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681214208:0@lo:400:kworker.0 00010000:00080000:2.0:1788201210.496971:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c3100 x1875064681214720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201210.496983:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681214720:0@lo:400:kworker.0 00010000:00080000:2.0:1788201210.496994:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c3480 x1875064681215232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201210.497003:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681215232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201210.497048:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681214976:0@lo:400:kworker.0 00000100:00100000:0.0:1788201210.497063:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681213696:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.561281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201210.561334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201210.561372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201210.561407:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662270976 00000100:00100000:3.0:1788201210.561419:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662270976 00000100:00100000:3.0:1788201210.561543:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662270848 00000100:00100000:3.0:1788201210.561546:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662270848 00000100:00100000:3.0:1788201210.561572:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:3.0:1788201210.561584:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662270976:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201210.561697:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662270976:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 115us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.561698:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662270720 00000100:00100000:1.0:1788201210.561703:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662270720 00000100:00100000:3.0:1788201210.561724:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:1.0:1788201210.561768:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 280 00000100:00100000:2.0:1788201210.561775:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00100000:1.0:1788201210.561778:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2400:x1875064662270720:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201210.561791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662270848:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201210.561815:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2400:x1875064662270720:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 40us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.561823:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 280 00000100:00100000:2.0:1788201210.561834:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662270848:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 48us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.561842:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00080000:3.0:1788201210.562156:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201210.562162:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201210.998967:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201210.999001:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681215488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201210.999091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201210.999203:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681215488 00000100:00100000:1.0:1788201210.999214:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681215488 00000100:00100000:1.0:1788201210.999280:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201210.999300:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681215488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201210.999331:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201210.999392:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681215488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.999401:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788201210.999528:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4e9500 x1875064681215488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201210.999553:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681215488:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201211.062030:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201211.514489:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:3.0:1788201211.514512:0:9511:0:(genops.c:906:class_export_put()) final put ffff9ce0bf458800/da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:0.0:1788201211.514592:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf458800/da566c69-17bd-4938-bc1e-8b9ba2633293 for lustre-OST0001 00000001:00100000:3.0:1788201211.514763:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:3.0:1788201211.514767:0:8425:0:(genops.c:906:class_export_put()) final put ffff9ce0a64b8000/da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:0.0:1788201211.514860:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf45c000 for lustre-OST0001 00000020:00000080:0.0:1788201211.514917:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a64b8000/da566c69-17bd-4938-bc1e-8b9ba2633293 for lustre-OST0000 00000020:00000080:0.0:1788201211.514982:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a64b8800 for lustre-OST0000 00000001:02000400:2.0:1788201211.974725:0:11217:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.54 00010000:00010000:1.0:1788201212.086879:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201212.538329:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681215616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201212.538433:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201212.538540:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681215616 00000100:00100000:2.0:1788201212.538548:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681215616 00000100:00100000:2.0:1788201212.538603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201212.538623:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681215616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201212.538670:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201212.538724:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681215616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201212.538731:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201212.538811:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681215616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201212.538958:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201212.538968:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681215744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201212.539000:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201212.539032:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681215744 00000100:00100000:0.0:1788201212.539036:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681215744 00000100:00100000:0.0:1788201212.539061:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201212.539067:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681215744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201212.539085:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788201212.539117:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681215744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201212.539123:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201212.539150:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681215744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201213.049134:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681215872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201213.049222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201213.049314:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681215872 00000100:00100000:3.0:1788201213.049323:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681215872 00000100:00100000:3.0:1788201213.049388:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201213.049401:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681215872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201213.049436:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201213.049485:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681215872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201213.049493:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788201213.049517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201213.049578:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c1c00 x1875064681215872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201213.049600:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681215872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201213.050062:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201213.050082:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681216000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201213.050119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201213.050191:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681216000 00000100:00100000:1.0:1788201213.050197:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681216000 00000100:00100000:1.0:1788201213.050235:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201213.050243:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681216000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201213.050256:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201213.050293:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681216000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201213.050309:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788201213.050341:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0700 x1875064681216000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201213.050356:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681216000:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201213.051973:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201213.113266:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201214.097999:0:11314:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.54 00010000:00010000:3.0:1788201214.138117:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201215.157993:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201215.606882:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681216128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201215.606977:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201215.607080:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681216128 00000100:00100000:3.0:1788201215.607089:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681216128 00000100:00100000:3.0:1788201215.607149:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201215.607159:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681216128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201215.607197:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201215.607400:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681216128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 240us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.607409:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201215.607671:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681216384:0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.607711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201215.607752:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681216896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.607775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201215.607792:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681217408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.607812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201215.607832:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201215.607837:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681216512:0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.607863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201215.607880:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681217024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.607899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201215.607915:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681217536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.607934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201215.608185:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201215.608203:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681216384 00000100:00100000:2.0:1788201215.608208:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681216384 00000100:00100000:2.0:1788201215.608237:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681216896 00000100:00100000:2.0:1788201215.608241:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681216896 00000100:00100000:2.0:1788201215.608260:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681217408 00000100:00100000:2.0:1788201215.608263:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681217408 00000100:00100000:2.0:1788201215.608274:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681217024 00000100:00100000:2.0:1788201215.608277:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681217024 00000100:00100000:2.0:1788201215.608289:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681217536 00000100:00100000:2.0:1788201215.608291:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681217536 00000100:00100000:2.0:1788201215.608304:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201215.608311:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681216384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.608365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681216384:12345-0@lo:400:kworker.0 Request processed in 53us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.608372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201215.608559:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201215.608567:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681216896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.608779:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681216896:12345-0@lo:400:kworker.0 Request processed in 212us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.608787:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201215.608801:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201215.608807:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681217408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.608832:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681217408:12345-0@lo:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.608844:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201215.608856:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788201215.608861:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681217024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.608888:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681217024:12345-0@lo:400:kworker.0 Request processed in 27us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.608893:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788201215.608905:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201215.608911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681217536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.608936:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681217536:12345-0@lo:400:kworker.0 Request processed in 25us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.608941:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201215.608969:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681216512 00000100:00100000:2.0:1788201215.608973:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681216512 00000100:00100000:2.0:1788201215.609003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201215.609009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681216512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609039:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681216512:12345-0@lo:400:kworker.0 Request processed in 31us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.609045:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788201215.609086:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201215.609091:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201215.609127:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681216512:0@lo:400:kworker.0 00010000:00080000:2.0:1788201215.609141:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b2d80 x1875064681217024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201215.609151:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681217024:0@lo:400:kworker.0 00010000:00080000:2.0:1788201215.609166:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fc000 x1875064681217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201215.609180:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681217536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609193:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681216384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609203:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681216896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609213:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681217408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609281:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681216256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201215.609347:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681216768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201215.609577:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681217280:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201215.609691:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788201215.609699:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681216640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.609722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201215.609755:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681216256 00000100:00100000:2.0:1788201215.609756:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681217152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.609760:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681216256 00000100:00100000:2.0:1788201215.609778:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201215.609791:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788201215.609799:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681216256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.609837:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681216256:12345-0@lo:400:kworker.0 Request processed in 39us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.609853:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788201215.610822:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681216768 00000100:00100000:0.0:1788201215.610832:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681216768 00000100:00100000:0.0:1788201215.610874:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788201215.610882:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681216768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201215.610947:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681216768:12345-0@lo:400:kworker.0 Request processed in 67us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201215.610953:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201215.610954:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681217664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.610982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201215.611002:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681217280 00000100:00100000:3.0:1788201215.611007:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681217280 00000100:00100000:3.0:1788201215.611045:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681217152 00000100:00100000:3.0:1788201215.611049:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681217152 00000100:00100000:3.0:1788201215.611072:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201215.611079:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681217280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201215.611114:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681217280:12345-0@lo:400:kworker.0 Request processed in 36us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.611120:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201215.611131:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201215.611136:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681217152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201215.611161:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681217152:12345-0@lo:400:kworker.0 Request processed in 25us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.611172:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788201215.611189:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201215.611844:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681216256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.611861:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681216768:0@lo:400:kworker.0 00010000:00080000:2.0:1788201215.611874:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c8000 x1875064681217280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201215.611895:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681217280:0@lo:400:kworker.0 00010000:00080000:2.0:1788201215.611924:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b1880 x1875064681217152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201215.611931:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681217152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.611957:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681216640 00000100:00100000:2.0:1788201215.611961:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681216640 00000100:00100000:2.0:1788201215.611995:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201215.612001:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681216640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.612049:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681216640:12345-0@lo:400:kworker.0 Request processed in 48us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.612056:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1788201215.612097:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c1c00 x1875064681216128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201215.612117:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681216128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201215.612145:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681216640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201215.614933:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681217664 00000100:00100000:0.0:1788201215.614952:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681217664 00000100:00100000:0.0:1788201215.615044:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201215.615057:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681217664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201215.615173:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681217664:12345-0@lo:400:kworker.0 Request processed in 119us (4189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201215.615182:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788201215.615208:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201215.615252:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf825fc380 x1875064681217664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201215.615268:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681217664:0@lo:400:kworker.0 00000001:02000400:1.0:1788201215.618613:0:11362:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 31 14:33:33 EDT 2026 00000100:00100000:3.0:1788201215.684712:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201215.684782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201215.684789:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662271104 00000100:00100000:1.0:1788201215.684803:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662271104 00000100:00100000:3.0:1788201215.684875:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201215.684941:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 282 00000100:00100000:1.0:1788201215.684954:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2399:x1875064662271104:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201215.685319:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662271232 00000100:00100000:3.0:1788201215.685324:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662271232 00000100:00100000:3.0:1788201215.685371:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662271360 00000100:00100000:3.0:1788201215.685375:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662271360 00000100:00100000:3.0:1788201215.685445:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:3.0:1788201215.685454:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662271232:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201215.685788:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 108 00000100:00100000:0.0:1788201215.685801:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662271360:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201215.690402:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2399:x1875064662271104:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 5433us (5701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.690421:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 282 00000100:00100000:3.0:1788201215.690561:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662271232:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 4983us (5654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.690648:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:0.0:1788201215.698929:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662271360:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 13111us (14032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201215.698948:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 108 00000100:00080000:0.0:1788201215.699008:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201215.699015:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201216.118097:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681217792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201216.118195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201216.119024:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681217792 00000100:00100000:3.0:1788201216.119036:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681217792 00000100:00100000:3.0:1788201216.119107:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201216.119119:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681217792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201216.119150:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201216.119554:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681217792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 435us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201216.119561:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788201216.120060:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4eb100 x1875064681217792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201216.120083:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681217792:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201216.181962:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201217.209670:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201217.656866:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201217.656900:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681217920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201217.656996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201217.658792:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681217920 00000100:00100000:2.0:1788201217.658824:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681217920 00000100:00100000:2.0:1788201217.658892:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201217.658904:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681217920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201217.658958:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201217.659056:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681217920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201217.659064:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201217.659124:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201217.659138:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681218048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201217.659189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201217.659225:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681218048 00000100:00100000:2.0:1788201217.659229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681218048 00000100:00100000:2.0:1788201217.659251:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201217.659257:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681218048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201217.659280:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201217.659484:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681218048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201217.659491:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201217.659539:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681218048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201217.659587:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681217920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201218.167284:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681218176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201218.167370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201218.167535:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681218176 00000100:00100000:0.0:1788201218.167555:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681218176 00000100:00100000:0.0:1788201218.167635:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201218.167646:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681218176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201218.167683:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201218.167733:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681218176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.167769:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788201218.167819:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834cce00 x1875064681218176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201218.167838:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681218176:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201218.167951:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201218.168356:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681218304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201218.168393:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201218.168548:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681218304 00000100:00100000:0.0:1788201218.168554:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681218304 00000100:00100000:0.0:1788201218.168608:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201218.168616:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681218304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201218.168630:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788201218.168692:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201218.169024:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8362c700 x1875064681218304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201218.169132:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681218304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 515us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.169140:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201218.169185:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681218304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201218.231430:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201219.254377:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201220.279994:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201220.726193:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201220.726223:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681218432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201220.726312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201220.726390:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681218432 00000100:00100000:3.0:1788201220.726400:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681218432 00000100:00100000:3.0:1788201220.726470:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201220.726483:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681218432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201220.726523:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201220.726592:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681218432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201220.726601:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788201220.726626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201220.726666:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c2a00 x1875064681218432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201220.726690:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681218432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201220.744256:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681218944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744346:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744398:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681219456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744447:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681219968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744496:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201220.744515:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681218560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744581:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681219072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744623:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681219584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744667:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681218688:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744708:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744729:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681219200:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744799:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681219712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744818:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744837:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788201220.744843:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681218816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744864:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744882:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681219328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744905:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744919:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681219840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.744936:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.744965:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681218944 00000100:00100000:0.0:1788201220.744973:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681218944 00000100:00100000:0.0:1788201220.745016:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681218688 00000100:00100000:0.0:1788201220.745019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681218688 00000100:00100000:0.0:1788201220.745029:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681219200 00000100:00100000:0.0:1788201220.745031:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681219200 00000100:00100000:0.0:1788201220.745050:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681219712 00000100:00100000:0.0:1788201220.745057:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681219712 00000100:00100000:0.0:1788201220.745068:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681219328 00000100:00100000:0.0:1788201220.745070:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681219328 00000100:00100000:0.0:1788201220.745080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681219840 00000100:00100000:0.0:1788201220.745082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681219840 00000100:00100000:0.0:1788201220.745098:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201220.745107:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681218944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745164:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681218944:12345-0@lo:400:kworker.0 Request processed in 57us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201220.745186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201220.745190:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681218688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745214:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681218688:12345-0@lo:400:kworker.0 Request processed in 24us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745219:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201220.745228:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201220.745232:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681219200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745252:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681219200:12345-0@lo:400:kworker.0 Request processed in 20us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201220.745264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201220.745269:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681219712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745290:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681219712:12345-0@lo:400:kworker.0 Request processed in 21us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745295:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201220.745303:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788201220.745307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681219328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745340:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681219328:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745346:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788201220.745356:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788201220.745363:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681219840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745388:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681219840:12345-0@lo:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788201220.745413:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681219456 00000100:00100000:0.0:1788201220.745417:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681219456 00000100:00100000:0.0:1788201220.745443:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681219968 00000100:00100000:0.0:1788201220.745446:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681219968 00000100:00100000:0.0:1788201220.745459:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681219584 00000100:00100000:0.0:1788201220.745462:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681219584 00000100:00100000:0.0:1788201220.745472:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201220.745477:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681219456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745520:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681219456:12345-0@lo:400:kworker.0 Request processed in 42us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745527:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201220.745539:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201220.745545:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681219968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745584:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681219968:12345-0@lo:400:kworker.0 Request processed in 39us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745590:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201220.745601:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201220.745606:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681219584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745642:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681219584:12345-0@lo:400:kworker.0 Request processed in 36us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745648:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201220.745672:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681219072 00000100:00100000:0.0:1788201220.745675:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681219072 00000100:00100000:0.0:1788201220.745700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681218816 00000100:00100000:0.0:1788201220.745703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681218816 00000100:00100000:0.0:1788201220.745715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201220.745721:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681219072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745781:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681219072:12345-0@lo:400:kworker.0 Request processed in 59us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745787:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201220.745799:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201220.745805:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681218816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.745832:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681218816:12345-0@lo:400:kworker.0 Request processed in 27us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.745838:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788201220.745881:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201220.745887:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201220.745889:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201220.745892:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201220.745935:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681218816:0@lo:400:kworker.0 00010000:00080000:0.0:1788201220.745951:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50dc00 x1875064681219328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201220.745963:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681219328:0@lo:400:kworker.0 00010000:00080000:0.0:1788201220.745973:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50d880 x1875064681219840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201220.745988:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681219840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.746000:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681218688:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.746010:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681219200:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.746020:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681219712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.746064:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681219072:0@lo:400:kworker.0 00010000:00080000:0.0:1788201220.746074:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50c380 x1875064681219584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201220.746083:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681219584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.746094:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681218944:0@lo:400:kworker.0 00010000:00080000:0.0:1788201220.746103:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50d500 x1875064681219456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201220.746112:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681219456:0@lo:400:kworker.0 00010000:00080000:0.0:1788201220.746122:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50fb80 x1875064681219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201220.746131:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681219968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201220.746334:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681218560 00000100:00100000:1.0:1788201220.746340:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681218560 00000100:00100000:1.0:1788201220.746387:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788201220.746395:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681218560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201220.746452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681218560:12345-0@lo:400:kworker.0 Request processed in 59us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201220.746459:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788201220.752174:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681218560:0@lo:400:kworker.0 00000100:00100000:3.0:1788201220.808832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201220.808872:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201220.808894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201220.809508:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662271488 00000100:00100000:1.0:1788201220.809524:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662271488 00000100:00100000:1.0:1788201220.809604:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 284 00000100:00100000:1.0:1788201220.809617:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2398:x1875064662271488:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201220.809711:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2398:x1875064662271488:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 97us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201220.809727:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 284 00000100:00100000:0.0:1788201220.811675:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662271744 00000100:00100000:0.0:1788201220.811692:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662271744 00000100:00100000:0.0:1788201220.811875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662271616 00000100:00100000:0.0:1788201220.811880:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662271616 00000100:00100000:0.0:1788201220.811919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:0.0:1788201220.811931:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662271744:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201220.812026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662271744:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 97us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.812033:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:0.0:1788201220.812050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:0.0:1788201220.812057:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662271616:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201220.812083:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662271616:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.812089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00080000:3.0:1788201220.815522:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201220.815534:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201221.239335:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201221.239369:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681220096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201221.239472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201221.239778:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681220096 00000100:00100000:0.0:1788201221.239788:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681220096 00000100:00100000:0.0:1788201221.239857:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201221.239870:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681220096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201221.239902:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201221.239960:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681220096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201221.239968:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788201221.240164:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83715880 x1875064681220096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201221.240232:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681220096:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201221.308621:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201222.340441:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201222.774347:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681220224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201222.774438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201222.774620:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681220224 00000100:00100000:3.0:1788201222.774628:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681220224 00000100:00100000:3.0:1788201222.774687:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201222.774706:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681220224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201222.774766:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201222.774816:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681220224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201222.774822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201222.774869:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681220224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201222.777112:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681220352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201222.777195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201222.777289:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681220352 00000100:00100000:3.0:1788201222.777298:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681220352 00000100:00100000:3.0:1788201222.777365:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201222.777376:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681220352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201222.777420:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788201222.780321:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681220352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2933us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201222.780350:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201222.782653:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681220352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201223.286016:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681220608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201223.286106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201223.286190:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201223.286196:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681220480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201223.286217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201223.286310:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681220608 00000100:00100000:0.0:1788201223.286321:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681220608 00000100:00100000:0.0:1788201223.286385:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681220480 00000100:00100000:0.0:1788201223.286389:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681220480 00000100:00100000:2.0:1788201223.286400:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201223.286415:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681220608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201223.286449:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201223.286498:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681220608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (392us total) trans 0 rc 0/0 00000100:00080000:3.0:1788201223.286974:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201223.288120:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4eb100 x1875064681220608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201223.288150:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681220608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201223.295926:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201223.296053:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201223.296094:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681220480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201223.296133:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201223.296328:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681220480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 242us (10108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201223.296336:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788201223.296448:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83716680 x1875064681220480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201223.296476:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681220480:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201223.350021:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201224.374997:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201225.399095:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201225.845946:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201225.845980:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681220736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201225.846070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201225.846210:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681220736 00000100:00100000:0.0:1788201225.846219:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681220736 00000100:00100000:0.0:1788201225.846291:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201225.846304:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681220736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201225.846342:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201225.846397:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681220736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.846405:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788201225.846459:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c1f80 x1875064681220736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201225.846481:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681220736:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201225.846608:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201225.846841:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681220992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.846882:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201225.846903:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681221504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.846951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201225.846971:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681222016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.846992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201225.847010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201225.847015:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681221120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.847037:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201225.847058:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681221632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.847077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201225.847089:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681222144:0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.847107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201225.847135:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681221120 00000100:00100000:2.0:1788201225.847140:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681221120 00000100:00100000:2.0:1788201225.847440:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201225.847451:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681221120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.847526:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681221120:12345-0@lo:400:kworker.0 Request processed in 76us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201225.847534:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788201225.847784:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681220992 00000100:00100000:0.0:1788201225.847790:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681220992 00000100:00100000:0.0:1788201225.847812:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681221504 00000100:00100000:0.0:1788201225.847815:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681221504 00000100:00100000:0.0:1788201225.847838:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681222016 00000100:00100000:0.0:1788201225.847841:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681222016 00000100:00100000:0.0:1788201225.847852:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681221632 00000100:00100000:0.0:1788201225.847854:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681221632 00000100:00100000:0.0:1788201225.847865:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681222144 00000100:00100000:0.0:1788201225.847867:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681222144 00000100:00100000:0.0:1788201225.847878:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201225.847884:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681220992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.847930:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681220992:12345-0@lo:400:kworker.0 Request processed in 46us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.847937:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201225.847949:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201225.847955:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681221504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.847980:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681221504:12345-0@lo:400:kworker.0 Request processed in 25us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.847985:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201225.847996:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788201225.848001:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681222016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848024:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681222016:12345-0@lo:400:kworker.0 Request processed in 23us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.848029:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788201225.848039:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788201225.848045:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681221632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848068:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681221632:12345-0@lo:400:kworker.0 Request processed in 24us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.848073:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788201225.848083:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788201225.848088:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681222144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848125:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681222144:12345-0@lo:400:kworker.0 Request processed in 36us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.848131:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788201225.848170:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681221248:0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848221:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201225.848244:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681221760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201225.848306:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681222272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201225.848351:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788201225.848358:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681220864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848386:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201225.848407:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681221376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201225.848448:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681221888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848469:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201225.848496:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681221760 00000100:00100000:0.0:1788201225.848500:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681221760 00000100:00100000:0.0:1788201225.848538:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681222272 00000100:00100000:0.0:1788201225.848542:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681222272 00000100:00100000:0.0:1788201225.848557:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681221888 00000100:00100000:0.0:1788201225.848559:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681221888 00000100:00100000:0.0:1788201225.848571:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201225.848578:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681221760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848613:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681221760:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.848618:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201225.848629:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201225.848635:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681222272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848663:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681222272:12345-0@lo:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.848675:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201225.848698:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201225.848704:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681221888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848783:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681221888:12345-0@lo:400:kworker.0 Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.848789:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201225.848811:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681221376 00000100:00100000:0.0:1788201225.848815:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681221376 00000100:00100000:0.0:1788201225.848839:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788201225.848845:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681221376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.848875:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681221376:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.848881:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788201225.848933:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681221376:0@lo:400:kworker.0 00010000:00080000:0.0:1788201225.848947:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0700 x1875064681221888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201225.848957:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681221888:0@lo:400:kworker.0 00010000:00080000:0.0:1788201225.848967:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b3480 x1875064681221760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201225.848975:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681221760:0@lo:400:kworker.0 00010000:00080000:0.0:1788201225.848983:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b2d80 x1875064681222272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201225.848990:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681222272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.849028:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681221248 00000100:00100000:0.0:1788201225.849032:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681221248 00000100:00100000:0.0:1788201225.849057:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788201225.849063:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681221248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201225.849098:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681221248:12345-0@lo:400:kworker.0 Request processed in 35us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201225.849103:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788201225.849129:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681221248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201225.849971:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681221120:0@lo:400:kworker.0 00010000:00080000:3.0:1788201225.849989:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b1500 x1875064681221632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201225.849998:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681221632:0@lo:400:kworker.0 00010000:00080000:3.0:1788201225.850008:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b3100 x1875064681222144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201225.850015:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681222144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201225.850027:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681220992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201225.850039:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681221504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201225.850049:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681222016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.850249:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681220864 00000100:00100000:2.0:1788201225.850256:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681220864 00000100:00100000:2.0:1788201225.850298:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788201225.850307:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681220864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201225.850631:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681220864:12345-0@lo:400:kworker.0 Request processed in 324us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201225.850639:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:2.0:1788201225.850764:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201225.850771:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201225.850775:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201225.850777:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201225.850902:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681220864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.924358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201225.926308:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662272000 00000100:00100000:2.0:1788201225.926329:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662272000 00000100:00100000:2.0:1788201225.926417:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1788201225.926429:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662272000:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201225.926539:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662272000:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 111us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201225.926546:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00080000:2.0:1788201225.926574:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201225.926632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201225.926806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201225.926831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662272128 00000100:00100000:2.0:1788201225.926835:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662272128 00000100:00100000:2.0:1788201225.926870:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:2.0:1788201225.926876:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662272128:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201225.926917:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662272128:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 41us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201225.926925:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00080000:2.0:1788201225.926945:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201225.927065:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662271872 00000100:00100000:1.0:1788201225.927070:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662271872 00000100:00100000:1.0:1788201225.927114:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 286 00000100:00100000:1.0:1788201225.927122:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2399:x1875064662271872:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201225.927157:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2399:x1875064662271872:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201225.927164:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 286 00000100:00100000:3.0:1788201226.359023:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681222400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201226.359120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201226.359270:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681222400 00000100:00100000:0.0:1788201226.359281:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681222400 00000100:00100000:0.0:1788201226.359350:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201226.359362:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681222400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201226.359395:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201226.359458:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681222400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201226.359466:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788201226.359556:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83715c00 x1875064681222400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201226.359576:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681222400:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201226.421947:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201227.447838:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201227.899355:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201227.899386:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681222528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201227.899472:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201227.899565:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681222528 00000100:00100000:1.0:1788201227.899641:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681222528 00000100:00100000:1.0:1788201227.899701:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201227.899712:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681222528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201227.899838:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201227.899902:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681222528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 190us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201227.899911:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201227.899964:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681222528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201227.900444:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681222656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201227.900648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201227.904860:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681222656 00000100:00100000:2.0:1788201227.904880:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681222656 00000100:00100000:2.0:1788201227.904945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201227.904957:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681222656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201227.905007:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201227.905130:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681222656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (4481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201227.905138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201227.905981:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681222656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201228.407251:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681222784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201228.407363:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201228.407459:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681222784 00000100:00100000:0.0:1788201228.407471:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681222784 00000100:00100000:0.0:1788201228.407564:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201228.407578:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681222784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201228.407617:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201228.407685:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681222784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.407693:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788201228.407778:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201228.407927:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83715500 x1875064681222784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201228.407972:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681222784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201228.411199:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201228.411275:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681222912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201228.411369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201228.412250:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681222912 00000100:00100000:0.0:1788201228.412263:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681222912 00000100:00100000:0.0:1788201228.412400:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201228.412412:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681222912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201228.412455:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201228.412549:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681222912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.412557:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788201228.419245:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201228.419962:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83717480 x1875064681222912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201228.420003:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681222912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201228.471033:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201229.495082:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201230.518387:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201230.966094:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681223040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201230.966193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.966293:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681223040 00000100:00100000:0.0:1788201230.966303:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681223040 00000100:00100000:0.0:1788201230.966384:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201230.966396:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681223040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201230.966435:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201230.966496:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681223040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.966504:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788201230.966560:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c1f80 x1875064681223040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201230.966585:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681223040:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201230.966728:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201230.967545:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681223168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201230.967629:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.967837:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681223168 00000100:00100000:0.0:1788201230.967844:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681223168 00000100:00100000:0.0:1788201230.967888:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788201230.967897:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681223168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968048:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681223552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968105:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681224064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968148:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681224576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968186:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201230.968192:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681223680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968244:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681224192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968292:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681223296:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968339:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968359:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681223808:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968397:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968419:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681224320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968459:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201230.968465:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681223424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968516:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681223936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968552:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681224448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968569:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.968600:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681223552 00000100:00100000:1.0:1788201230.968605:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681223552 00000100:00100000:1.0:1788201230.968633:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681223296 00000100:00100000:1.0:1788201230.968636:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681223296 00000100:00100000:1.0:1788201230.968647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681223808 00000100:00100000:1.0:1788201230.968649:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681223808 00000100:00100000:1.0:1788201230.968672:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681224320 00000100:00100000:1.0:1788201230.968675:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681224320 00000100:00100000:1.0:1788201230.968686:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681223936 00000100:00100000:1.0:1788201230.968688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681223936 00000100:00100000:1.0:1788201230.968699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681224448 00000100:00100000:1.0:1788201230.968701:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681224448 00000100:00100000:1.0:1788201230.968713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788201230.968719:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681223552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968792:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681223552:12345-0@lo:400:kworker.0 Request processed in 72us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.968806:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788201230.968823:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788201230.968829:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681223296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968862:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681223296:12345-0@lo:400:kworker.0 Request processed in 34us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.968867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788201230.968878:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201230.968884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681223808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968909:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681223808:12345-0@lo:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.968914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201230.968925:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201230.968931:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681224320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.968971:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681224320:12345-0@lo:400:kworker.0 Request processed in 40us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.968977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201230.968989:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201230.968994:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681223936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969018:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681223936:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.969023:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201230.969032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788201230.969038:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681224448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969061:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681224448:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.969072:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788201230.969093:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681224064 00000100:00100000:1.0:1788201230.969096:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681224064 00000100:00100000:1.0:1788201230.969121:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681224576 00000100:00100000:1.0:1788201230.969124:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681224576 00000100:00100000:1.0:1788201230.969137:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681224192 00000100:00100000:1.0:1788201230.969140:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681224192 00000100:00100000:1.0:1788201230.969151:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201230.969157:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681224064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969190:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681224064:12345-0@lo:400:kworker.0 Request processed in 33us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.969196:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201230.969206:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201230.969211:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681224576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969250:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681224576:12345-0@lo:400:kworker.0 Request processed in 38us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.969256:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201230.969267:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201230.969272:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681224192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969297:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681224192:12345-0@lo:400:kworker.0 Request processed in 25us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.969302:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201230.969326:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681223680 00000100:00100000:1.0:1788201230.969329:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681223680 00000100:00100000:1.0:1788201230.969352:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681223424 00000100:00100000:1.0:1788201230.969355:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681223424 00000100:00100000:1.0:1788201230.969367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201230.969379:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681223680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969414:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681223680:12345-0@lo:400:kworker.0 Request processed in 36us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.969421:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201230.969432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788201230.969438:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681223424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969465:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681223424:12345-0@lo:400:kworker.0 Request processed in 28us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.969471:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788201230.969527:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201230.969533:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201230.969536:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201230.969538:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201230.969577:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681223680:0@lo:400:kworker.0 00010000:00080000:1.0:1788201230.969593:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c8aa00 x1875064681224192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201230.969605:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681224192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969617:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681223552:0@lo:400:kworker.0 00010000:00080000:1.0:1788201230.969627:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e1c6300 x1875064681224064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201230.969635:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681224064:0@lo:400:kworker.0 00010000:00080000:1.0:1788201230.969644:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82607800 x1875064681224576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201230.969652:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681224576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969706:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681223424:0@lo:400:kworker.0 00010000:00080000:1.0:1788201230.969718:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e1c5180 x1875064681223936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201230.969727:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681223936:0@lo:400:kworker.0 00010000:00080000:1.0:1788201230.969761:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c89f80 x1875064681224448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201230.969771:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681224448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969783:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681223296:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969793:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681223808:0@lo:400:kworker.0 00000100:00100000:1.0:1788201230.969803:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681224320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201230.970399:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681223168:12345-0@lo:400:kworker.0 Request processed in 2498us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.970409:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788201230.970588:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681223168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.050691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201231.050793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201231.050829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201231.050863:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662272512 00000100:00100000:2.0:1788201231.050875:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662272512 00000100:00100000:2.0:1788201231.050943:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662272384 00000100:00100000:2.0:1788201231.050947:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662272384 00000100:00100000:2.0:1788201231.050975:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:2.0:1788201231.050988:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662272512:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201231.051078:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662272512:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 93us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.051087:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:2.0:1788201231.051107:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:2.0:1788201231.051114:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662272384:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201231.051138:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662272384:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.051145:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00080000:2.0:1788201231.051162:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201231.051167:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201231.051571:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662272256 00000100:00100000:3.0:1788201231.051576:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662272256 00000100:00100000:3.0:1788201231.051623:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 288 00000100:00100000:3.0:1788201231.051631:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2398:x1875064662272256:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201231.051674:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2398:x1875064662272256:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 44us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.051681:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 288 00000001:02000400:1.0:1788201231.057546:0:11991:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:33:48 (1788201228) === 00000100:00100000:2.0:1788201231.454495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201231.454605:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662272640 00000100:00100000:0.0:1788201231.454618:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662272640 00000100:00100000:0.0:1788201231.454690:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 289 00000100:00100000:0.0:1788201231.454702:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:8724:x1875064662272640:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201231.454797:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201231.454823:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44720348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbf46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.454874:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44720348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf46 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.454889:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44720348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf46 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.454899:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75c00, rc 0) 00000100:00100000:0.0:1788201231.454964:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8724:x1875064662272640:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 264us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.454971:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 289 00000100:00100000:2.0:1788201231.458712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201231.458894:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662272768 00000100:00100000:0.0:1788201231.458907:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662272768 00000100:00100000:0.0:1788201231.458975:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 290 00000100:00100000:0.0:1788201231.458987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8724:x1875064662272768:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788201231.459191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8724:x1875064662272768:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 206us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.459200:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 290 00000100:00100000:2.0:1788201231.470837:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.471055:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662272896 00000100:00100000:3.0:1788201231.471069:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662272896 00000100:00100000:3.0:1788201231.471146:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 291 00000100:00100000:3.0:1788201231.471158:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8724:x1875064662272896:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788201231.471361:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8724:x1875064662272896:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 204us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.471371:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 291 00000100:00100000:1.0:1788201231.479450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.480508:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662273024 00000100:00100000:3.0:1788201231.480525:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662273024 00000100:00100000:0.0:1788201231.480802:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681224704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201231.481147:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 292 00000100:00100000:3.0:1788201231.481162:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8728:x1875064662273024:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201231.481521:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8728:x1875064662273024:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 225us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.481542:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 292 00000100:00100000:0.0:1788201231.483820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201231.486714:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681224704 00000100:00100000:2.0:1788201231.486767:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681224704 00000100:00100000:2.0:1788201231.487491:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201231.487510:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681224704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201231.487570:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201231.487704:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681224704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 200us (3891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.487712:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788201231.487919:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83717480 x1875064681224704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201231.487947:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681224704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201231.529078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201231.532770:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662273152 00000100:00100000:1.0:1788201231.532790:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662273152 00000100:00100000:1.0:1788201231.533196:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 293 00000100:00100000:1.0:1788201231.533211:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8728:x1875064662273152:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201231.533451:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8728:x1875064662273152:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 244us (4388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.533471:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 293 00010000:00010000:3.0:1788201231.542283:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201231.543108:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.543240:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662273280 00000100:00100000:3.0:1788201231.543253:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662273280 00000100:00100000:3.0:1788201231.543347:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 294 00000100:00100000:3.0:1788201231.543362:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8728:x1875064662273280:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201231.543582:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8728:x1875064662273280:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 223us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.543592:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 294 00000100:00100000:2.0:1788201231.551094:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.553197:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662273408 00000100:00100000:3.0:1788201231.553220:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662273408 00000100:00100000:3.0:1788201231.553443:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 295 00000100:00100000:3.0:1788201231.553484:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:8724:x1875064662273408:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788201231.553511:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201231.553537:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855ba000/0xf9b71aee4472034f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbf77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.553575:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855ba000/0xf9b71aee4472034f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf77 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.553589:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855ba000/0xf9b71aee4472034f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf77 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.553600:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba000, rc 0) 00000100:00100000:3.0:1788201231.553708:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:8724:x1875064662273408:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 252us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.553759:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 295 00000100:00100000:2.0:1788201231.558575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201231.558791:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662273536 00000100:00100000:1.0:1788201231.558806:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662273536 00000100:00100000:1.0:1788201231.558877:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 296 00000100:00100000:1.0:1788201231.558891:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:8724:x1875064662273536:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788201231.558930:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788201231.558963:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201231.558967:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201231.558971:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788201231.558973:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788201231.558976:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788201231.564085:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:8724:x1875064662273536:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 5180us (5510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.564103:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 296 00000100:00100000:2.0:1788201231.567240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.571556:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662273664 00000100:00100000:3.0:1788201231.571578:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662273664 00000100:00100000:3.0:1788201231.571665:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 297 00000100:00100000:3.0:1788201231.571677:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:8724:x1875064662273664:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788201231.571702:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201231.571725:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbf7e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.573332:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.573356:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.573368:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bac00, rc 0) 00000100:00100000:3.0:1788201231.573468:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8724:x1875064662273664:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 1791us (6243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.573490:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 297 00000100:00100000:2.0:1788201231.583612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201231.583697:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662273792 00000100:00100000:1.0:1788201231.583712:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662273792 00000100:00100000:1.0:1788201231.583809:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 298 00000100:00100000:1.0:1788201231.583822:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8724:x1875064662273792:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201231.584020:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8724:x1875064662273792:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 200us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.584028:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 298 00000100:00100000:2.0:1788201231.586695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.586799:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662273920 00000100:00100000:3.0:1788201231.586811:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662273920 00000100:00100000:3.0:1788201231.586879:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 299 00000100:00100000:3.0:1788201231.586891:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8724:x1875064662273920:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788201231.587078:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8724:x1875064662273920:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 187us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.587086:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 299 00000100:00100000:2.0:1788201231.591294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201231.591639:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662274048 00000100:00100000:0.0:1788201231.591653:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662274048 00000100:00100000:0.0:1788201231.591727:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 300 00000100:00100000:0.0:1788201231.591762:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8734:x1875064662274048:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201231.591977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8734:x1875064662274048:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 239us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.591986:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 300 00000100:00100000:2.0:1788201231.597999:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.598151:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662274176 00000100:00100000:3.0:1788201231.598165:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662274176 00000100:00100000:3.0:1788201231.598292:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 301 00000100:00100000:3.0:1788201231.598306:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8734:x1875064662274176:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201231.598532:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:8734:x1875064662274176:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 228us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.598541:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 301 00000100:00100000:2.0:1788201231.609953:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201231.610099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201231.610311:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201231.610429:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662274944 00000100:00100000:1.0:1788201231.610441:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662274944 00000100:00100000:1.0:1788201231.610519:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662275072 00000100:00100000:1.0:1788201231.610522:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662275072 00000100:00100000:1.0:1788201231.610547:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:1.0:1788201231.610559:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662274944:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201231.610667:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662274944:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 110us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.610677:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:1.0:1788201231.610694:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:1.0:1788201231.610699:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662275072:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201231.610719:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662275072:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 20us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.610725:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:2.0:1788201231.611268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.613640:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662274304 00000100:00100000:3.0:1788201231.613661:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662274304 00000100:00100000:3.0:1788201231.613723:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662274560 00000100:00100000:3.0:1788201231.613727:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662274560 00000100:00100000:3.0:1788201231.613775:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:3.0:1788201231.613785:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875064662274304:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788201231.613825:0:8476:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 1faf6d77-706d-41b4-9836-f216205de0f1@192.168.203.2@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:3.0:1788201231.613879:0:8476:0:(genops.c:1406:class_connect()) connect: client 1faf6d77-706d-41b4-9836-f216205de0f1, cookie 0xf9b71aee4472035d 00000004:00100000:3.0:1788201231.613912:0:8476:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788201231.614067:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201231.614181:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+6:2397:x1875064662274304:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 395us (3869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.614190:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:3.0:1788201231.614213:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1788201231.614219:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875064662274560:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788201231.614235:0:8476:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 1faf6d77-706d-41b4-9836-f216205de0f1@192.168.203.2@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:3.0:1788201231.614262:0:8476:0:(genops.c:1406:class_connect()) connect: client 1faf6d77-706d-41b4-9836-f216205de0f1, cookie 0xf9b71aee44720364 00000004:00100000:3.0:1788201231.614277:0:8476:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788201231.614675:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf459800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201231.614709:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+6:2397:x1875064662274560:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 489us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.614716:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:1.0:1788201231.627400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201231.627448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201231.627549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201231.634706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662274688 00000100:00100000:0.0:1788201231.634732:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662274688 00000100:00100000:0.0:1788201231.634850:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662274432 00000100:00100000:0.0:1788201231.634855:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662274432 00000100:00100000:0.0:1788201231.634880:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662274816 00000100:00100000:0.0:1788201231.634884:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662274816 00000100:00100000:0.0:1788201231.634911:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1788201231.634922:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+6:0:x1875064662274688:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201231.634972:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788201231.635082:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+6:0:x1875064662274688:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 161us (7767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.635091:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1788201231.635113:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201231.635120:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+7:0:x1875064662274432:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201231.635139:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201231.635523:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:3.0:1788201231.635536:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+7:8724:x1875064662274816:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788201231.635551:0:8476:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201231.635596:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+7:8724:x1875064662274816:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 64us (8047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.635602:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1788201231.636398:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+6:0:x1875064662274432:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 1273us (8945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.636406:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00080000:1.0:1788201231.636524:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201231.636531:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201231.638605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.638675:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662275200 00000100:00100000:3.0:1788201231.638688:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662275200 00000100:00100000:3.0:1788201231.638855:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201231.638868:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+6:8724:x1875064662275200:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788201231.638989:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+6:8724:x1875064662275200:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 123us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.638997:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201231.648647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201231.648701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201231.648774:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662275584 00000100:00100000:3.0:1788201231.648775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201231.648786:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662275584 00000100:00100000:2.0:1788201231.648859:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:2.0:1788201231.648872:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1faf6d77-706d-41b4-9836-f216205de0f1+6:8724:x1875064662275584:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788201231.648988:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1faf6d77-706d-41b4-9836-f216205de0f1+6:8724:x1875064662275584:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 119us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.648996:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1788201231.649071:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662275328 00000100:00100000:1.0:1788201231.649076:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662275328 00000100:00100000:1.0:1788201231.649103:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662275456 00000100:00100000:1.0:1788201231.649107:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662275456 00000100:00100000:1.0:1788201231.649123:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:1.0:1788201231.649128:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875064662275328:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788201231.649156:0:8430:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 1faf6d77-706d-41b4-9836-f216205de0f1@192.168.203.2@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:1.0:1788201231.649189:0:8430:0:(genops.c:1406:class_connect()) connect: client 1faf6d77-706d-41b4-9836-f216205de0f1, cookie 0xf9b71aee4472036b 00002000:00100000:1.0:1788201231.649203:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1faf6d77-706d-41b4-9836-f216205de0f1/ffff9ce0b9737000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201231.649226:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788201231.649423:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:2.0:1788201231.649429:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875064662275456:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788201231.649469:0:8431:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 1faf6d77-706d-41b4-9836-f216205de0f1@192.168.203.2@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:2.0:1788201231.649500:0:8431:0:(genops.c:1406:class_connect()) connect: client 1faf6d77-706d-41b4-9836-f216205de0f1, cookie 0xf9b71aee44720372 00002000:00100000:2.0:1788201231.649505:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1faf6d77-706d-41b4-9836-f216205de0f1/ffff9ce0a64bf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201231.649512:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788201231.649566:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201231.649601:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ce0a64bd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201231.649637:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+6:2397:x1875064662275456:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 207us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.649644:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00002000:00080000:1.0:1788201231.649700:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201231.649725:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9733000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201231.649842:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1faf6d77-706d-41b4-9836-f216205de0f1+6:2397:x1875064662275328:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 713us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.649850:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:3.0:1788201231.652684:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201231.654109:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662275712 00000100:00100000:0.0:1788201231.654128:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662275712 00000100:00100000:0.0:1788201231.654212:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1788201231.654225:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1faf6d77-706d-41b4-9836-f216205de0f1+6:8724:x1875064662275712:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788201231.654389:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788201231.654508:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1faf6d77-706d-41b4-9836-f216205de0f1+6:8724:x1875064662275712:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 286us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.654516:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00010000:00010000:3.0:1788201232.566045:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201233.015839:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681224832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201233.015940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201233.016035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681224832 00000100:00100000:1.0:1788201233.016045:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681224832 00000100:00100000:1.0:1788201233.016103:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201233.016114:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b32ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681224832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201233.016158:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201233.016212:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b32ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681224832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201233.016219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201233.016703:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681224832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201233.017068:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681224960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201233.017122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201233.017844:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681224960 00000100:00100000:0.0:1788201233.017853:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681224960 00000100:00100000:0.0:1788201233.017905:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201233.017916:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681224960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201233.017949:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788201233.018008:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681224960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201233.018016:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201233.018057:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681224960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201233.526324:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201233.526357:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681225088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201233.526446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201233.526773:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681225088 00000100:00100000:0.0:1788201233.526783:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681225088 00000100:00100000:0.0:1788201233.526852:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201233.526865:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681225088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201233.526903:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201233.526965:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681225088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201233.526972:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788201233.527021:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12c380 x1875064681225088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201233.527042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681225088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201233.530033:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201233.530081:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681225216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201233.530173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201233.530229:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681225216 00000100:00100000:0.0:1788201233.530239:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681225216 00000100:00100000:0.0:1788201233.533135:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201233.533155:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681225216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201233.533194:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788201233.533412:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201233.534185:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681225216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1034us (4009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201233.534197:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788201233.534962:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83715c00 x1875064681225216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201233.534990:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681225216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201233.590970:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201234.619970:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201235.638787:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201236.086305:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681225344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201236.086404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201236.086914:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681225600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.086953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201236.086974:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681226112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.086997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201236.087013:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681226624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.087031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201236.087050:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201236.087055:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681225728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.087081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201236.087100:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681226240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.087122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201236.087137:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681226752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.087159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201236.087190:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681225728 00000100:00100000:3.0:1788201236.087199:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681225728 00000100:00100000:3.0:1788201236.087254:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201236.087264:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681225728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.087563:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681225600 00000100:00100000:2.0:1788201236.087568:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681225600 00000100:00100000:2.0:1788201236.087596:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681226112 00000100:00100000:2.0:1788201236.087599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681226112 00000100:00100000:2.0:1788201236.087626:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681226624 00000100:00100000:2.0:1788201236.087629:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681226624 00000100:00100000:2.0:1788201236.087643:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681226240 00000100:00100000:2.0:1788201236.087646:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681226240 00000100:00100000:2.0:1788201236.087657:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681226752 00000100:00100000:2.0:1788201236.087659:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681226752 00000100:00100000:2.0:1788201236.087673:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788201236.087680:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681225600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.087783:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681225600:12345-0@lo:400:kworker.0 Request processed in 59us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.087804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788201236.087826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788201236.087832:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681226112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.087861:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681226112:12345-0@lo:400:kworker.0 Request processed in 30us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.087867:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788201236.087879:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788201236.087885:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681226624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.087912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681226624:12345-0@lo:400:kworker.0 Request processed in 28us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.087917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788201236.087929:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201236.087934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681226240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.087960:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681226240:12345-0@lo:400:kworker.0 Request processed in 26us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.087966:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201236.087978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201236.087983:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681226752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088007:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681226752:12345-0@lo:400:kworker.0 Request processed in 25us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.088012:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201236.088036:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681225856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088066:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201236.088087:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681226368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201236.088141:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681226880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088162:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201236.088185:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201236.088192:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681225472:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201236.088244:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681225984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088265:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201236.088281:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681226496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088317:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201236.088341:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681226368 00000100:00100000:2.0:1788201236.088346:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681226368 00000100:00100000:2.0:1788201236.088373:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681226880 00000100:00100000:2.0:1788201236.088375:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681226880 00000100:00100000:2.0:1788201236.088388:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681226496 00000100:00100000:2.0:1788201236.088390:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681226496 00000100:00100000:2.0:1788201236.088404:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201236.088409:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681226368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088458:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681226368:12345-0@lo:400:kworker.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.088464:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201236.088476:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201236.088482:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681226880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088509:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681226880:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.088515:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201236.088533:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201236.088539:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681226496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088567:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681226496:12345-0@lo:400:kworker.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.088573:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201236.088600:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681225856 00000100:00100000:2.0:1788201236.088603:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681225856 00000100:00100000:2.0:1788201236.088618:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201236.088623:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681225856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088648:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681225856:12345-0@lo:400:kworker.0 Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.088653:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00080000:2.0:1788201236.088689:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550a80 x1875064681226496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201236.088705:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681226496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088715:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681225856:0@lo:400:kworker.0 00010000:00080000:2.0:1788201236.088723:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12ea00 x1875064681226368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201236.088731:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681226368:0@lo:400:kworker.0 00010000:00080000:2.0:1788201236.088763:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550000 x1875064681226880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201236.088771:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681226880:0@lo:400:kworker.0 00000100:00080000:2.0:1788201236.088829:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201236.088834:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201236.088842:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201236.088844:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201236.088877:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12c380 x1875064681226240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201236.088886:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681226240:0@lo:400:kworker.0 00010000:00080000:2.0:1788201236.088896:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550380 x1875064681226752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201236.088903:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681226752:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088913:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681225600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088923:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681226112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088932:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681226624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.088963:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681225984 00000100:00100000:2.0:1788201236.088966:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681225984 00000100:00100000:2.0:1788201236.088986:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788201236.088992:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681225984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.089030:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681225984:12345-0@lo:400:kworker.0 Request processed in 38us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.089036:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788201236.089059:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.089437:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681225728:12345-0@lo:400:kworker.0 Request processed in 2172us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201236.089455:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201236.089547:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681225344 00000100:00100000:1.0:1788201236.089553:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681225344 00000100:00100000:1.0:1788201236.089601:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201236.089609:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681225344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201236.089635:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201236.089680:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681225344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.089685:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201236.089719:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681225472 00000100:00100000:1.0:1788201236.089733:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681225472 00000100:00100000:1.0:1788201236.089784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788201236.089791:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681225472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.089826:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681225472:12345-0@lo:400:kworker.0 Request processed in 35us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.089832:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788201236.089878:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681225472:0@lo:400:kworker.0 00010000:00080000:1.0:1788201236.089894:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83710380 x1875064681225344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201236.089913:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681225344:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201236.090082:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201236.090147:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681225728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.598081:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681227008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201236.598174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201236.598311:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681227008 00000100:00100000:1.0:1788201236.598322:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681227008 00000100:00100000:1.0:1788201236.598388:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201236.598400:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681227008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201236.598429:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201236.598497:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681227008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.598504:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788201236.598548:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83710380 x1875064681227008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201236.598570:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681227008:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201236.663784:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201236.676690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201236.676821:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201236.676911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201236.676956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201236.676984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201236.677064:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662275968 00000100:00100000:1.0:1788201236.677077:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662275968 00000100:00100000:1.0:1788201236.677154:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662276224 00000100:00100000:1.0:1788201236.677157:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662276224 00000100:00100000:1.0:1788201236.677211:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:1.0:1788201236.677225:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662275968:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201236.677545:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662275968:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 322us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.677555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:1.0:1788201236.677578:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:1.0:1788201236.677586:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662276224:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201236.677615:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662276224:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.677621:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00080000:1.0:1788201236.677642:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201236.679513:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201236.679548:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201236.680081:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662276096 00000100:00100000:2.0:1788201236.680094:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662276096 00000100:00100000:2.0:1788201236.680165:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662276352 00000100:00100000:2.0:1788201236.680169:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662276352 00000100:00100000:2.0:1788201236.680695:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:2.0:1788201236.680708:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662276096:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201236.680827:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662276096:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 122us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.680836:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:2.0:1788201236.680856:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:2.0:1788201236.680863:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662276352:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201236.680890:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662276352:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.680896:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:2.0:1788201236.680924:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662276480 00000100:00100000:2.0:1788201236.680929:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662276480 00000100:00100000:2.0:1788201236.680970:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662276608 00000100:00100000:2.0:1788201236.680974:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662276608 00000100:00100000:2.0:1788201236.681364:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:2.0:1788201236.681374:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662276480:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201236.681408:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662276480:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 37us (4497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.681425:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:2.0:1788201236.681450:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:2.0:1788201236.681458:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662276608:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201236.681485:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662276608:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.681491:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:2.0:1788201236.681515:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662275840 00000100:00100000:2.0:1788201236.681518:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662275840 00000100:00100000:0.0:1788201236.681855:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 303 00000100:00100000:0.0:1788201236.681981:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2398:x1875064662275840:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201236.682843:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2398:x1875064662275840:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 866us (5894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201236.682854:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 303 00000100:00080000:2.0:1788201236.686838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201236.686851:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201236.686856:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1788201237.025708:0:12184:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:3.0:1788201237.629606:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1faf6d77-706d-41b4-9836-f216205de0f1 00000001:00100000:3.0:1788201237.629767:0:6495:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1faf6d77-706d-41b4-9836-f216205de0f1 00000001:00100000:0.0:1788201237.633880:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1faf6d77-706d-41b4-9836-f216205de0f1 00000001:00100000:1.0:1788201237.634755:0:7447:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1faf6d77-706d-41b4-9836-f216205de0f1 00010000:00010000:3.0:1788201237.689645:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201238.134090:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681227136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201238.134188:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201238.134357:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681227136 00000100:00100000:3.0:1788201238.134367:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681227136 00000100:00100000:3.0:1788201238.134436:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201238.134447:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681227136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201238.134493:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788201238.142038:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681227136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7581us (7839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.142057:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201238.142197:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681227264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201238.142276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201238.144613:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681227264 00000100:00100000:0.0:1788201238.144633:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681227264 00000100:00100000:0.0:1788201238.144752:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201238.144766:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681227264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201238.144816:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201238.145211:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681227136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201238.147636:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681227264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2863us (5348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.147672:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201238.148979:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681227264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201238.646265:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681227392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201238.646361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201238.648379:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681227392 00000100:00100000:0.0:1788201238.648398:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681227392 00000100:00100000:0.0:1788201238.648510:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201238.648526:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681227392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201238.648570:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201238.648676:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681227392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (2313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.648684:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788201238.648702:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201238.648765:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83715880 x1875064681227392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201238.648792:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681227392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201238.648993:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681227520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201238.649044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201238.650078:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681227520 00000100:00100000:0.0:1788201238.650089:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681227520 00000100:00080000:2.0:1788201238.650374:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201238.650934:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201238.650948:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681227520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201238.650979:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201238.651078:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681227520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.651085:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1788201238.651171:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf510e00 x1875064681227520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201238.651195:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681227520:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201238.709996:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.734174:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201240.759455:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201241.206333:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681227776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206440:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206498:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681228288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206542:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681228800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206585:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788201241.206592:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681227648:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206644:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681228160:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206668:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206685:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681228672:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206720:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681229184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206801:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681227904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206843:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681228416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206875:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681228928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206920:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201241.206926:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681228032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206948:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206958:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681228544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.206975:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.206989:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681229056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.207006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.207038:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681227648 00000100:00100000:3.0:1788201241.207047:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681227648 00000100:00100000:3.0:1788201241.207112:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788201241.207122:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681227648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.207182:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681227648:12345-0@lo:400:kworker.0 Request processed in 60us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.207190:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788201241.207227:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681228160 00000100:00100000:3.0:1788201241.207231:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681228160 00000100:00100000:3.0:1788201241.207257:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681227904 00000100:00100000:3.0:1788201241.207260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681227904 00000100:00100000:3.0:1788201241.207275:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201241.207280:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681228160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.207326:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681228160:12345-0@lo:400:kworker.0 Request processed in 45us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.207333:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201241.207344:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201241.207350:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681227904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.207380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681227904:12345-0@lo:400:kworker.0 Request processed in 31us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.207386:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201241.207446:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681227904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.207478:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681227648:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.207487:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681228160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.207768:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681227776 00000100:00100000:2.0:1788201241.207773:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681227776 00000100:00100000:2.0:1788201241.207812:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681228288 00000100:00100000:2.0:1788201241.207815:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681228288 00000100:00100000:2.0:1788201241.207838:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681228800 00000100:00100000:2.0:1788201241.207841:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681228800 00000100:00100000:2.0:1788201241.207868:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681228416 00000100:00100000:2.0:1788201241.207871:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681228416 00000100:00100000:2.0:1788201241.207882:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681228928 00000100:00100000:2.0:1788201241.207884:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681228928 00000100:00100000:2.0:1788201241.207894:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681228032 00000100:00100000:2.0:1788201241.207903:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681228032 00000100:00100000:2.0:1788201241.207920:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201241.207927:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681227776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.207979:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681227776:12345-0@lo:400:kworker.0 Request processed in 52us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.207985:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201241.207998:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201241.208004:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681228288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.208029:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681228288:12345-0@lo:400:kworker.0 Request processed in 25us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.208034:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201241.208259:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201241.208267:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681228800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.208298:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681228800:12345-0@lo:400:kworker.0 Request processed in 33us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.208304:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201241.208315:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788201241.208321:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681228416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.208350:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681228416:12345-0@lo:400:kworker.0 Request processed in 29us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.208355:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788201241.208365:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788201241.208370:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681228928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.208395:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681228928:12345-0@lo:400:kworker.0 Request processed in 25us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.208423:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788201241.208436:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788201241.208442:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681228032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.208472:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681228032:12345-0@lo:400:kworker.0 Request processed in 30us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.208478:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788201241.208511:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681228672 00000100:00100000:2.0:1788201241.208515:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681228672 00000100:00100000:2.0:1788201241.208536:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681229184 00000100:00100000:2.0:1788201241.208538:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681229184 00000100:00100000:2.0:1788201241.208547:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681228544 00000100:00100000:2.0:1788201241.208549:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681228544 00000100:00100000:2.0:1788201241.208559:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681229056 00000100:00100000:2.0:1788201241.208561:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681229056 00000100:00100000:2.0:1788201241.208572:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201241.208578:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681228672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.208615:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681228672:12345-0@lo:400:kworker.0 Request processed in 37us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.208621:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201241.208633:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201241.208641:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681229184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.208670:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681229184:12345-0@lo:400:kworker.0 Request processed in 31us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.208677:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201241.208690:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201241.208697:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681228544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.208774:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681228544:12345-0@lo:400:kworker.0 Request processed in 77us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.208778:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201241.208782:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201241.208796:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201241.208806:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681229312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201241.208807:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681229056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.210372:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681229056:12345-0@lo:400:kworker.0 Request processed in 1560us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.210385:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201241.210502:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681228032:0@lo:400:kworker.0 00010000:00080000:2.0:1788201241.210520:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf553100 x1875064681228544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201241.210531:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681228544:0@lo:400:kworker.0 00010000:00080000:2.0:1788201241.210542:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550a80 x1875064681229056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201241.210550:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681229056:0@lo:400:kworker.0 00010000:00080000:2.0:1788201241.210562:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550e00 x1875064681228416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201241.210570:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681228416:0@lo:400:kworker.0 00010000:00080000:2.0:1788201241.210581:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550000 x1875064681228928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201241.210590:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681228928:0@lo:400:kworker.0 00010000:00080000:2.0:1788201241.210639:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550700 x1875064681228672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201241.210657:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681228672:0@lo:400:kworker.0 00010000:00080000:2.0:1788201241.210672:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83408000 x1875064681229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201241.210680:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681229184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.210693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681227776:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.210704:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681228288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.210715:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681228800:0@lo:400:kworker.0 00000100:00080000:3.0:1788201241.212311:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201241.212322:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201241.212326:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201241.212329:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201241.215277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201241.215707:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681229312 00000100:00100000:2.0:1788201241.215719:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681229312 00000100:00100000:1.0:1788201241.216989:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201241.217010:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681229312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201241.217055:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201241.217156:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681229312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.217164:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1788201241.217419:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83711500 x1875064681229312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201241.217448:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681229312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201241.718218:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681229440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201241.718307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.718890:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681229440 00000100:00100000:3.0:1788201241.718899:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681229440 00000100:00100000:3.0:1788201241.718957:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201241.718967:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681229440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201241.718989:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201241.719170:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681229440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 204us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.719179:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788201241.719431:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83711500 x1875064681229440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201241.719452:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681229440:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201241.783706:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201241.796250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201241.796294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201241.796329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201241.796380:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662276864 00000100:00100000:1.0:1788201241.796386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201241.796412:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662276864 00000100:00100000:1.0:1788201241.796424:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201241.796512:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662277120 00000100:00100000:3.0:1788201241.796516:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662277120 00000100:00100000:3.0:1788201241.796533:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662276992 00000100:00100000:3.0:1788201241.796536:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662276992 00000100:00100000:3.0:1788201241.796557:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:3.0:1788201241.796567:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662276864:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201241.796661:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662276864:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 95us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.796669:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:3.0:1788201241.796686:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 152 00000100:00100000:3.0:1788201241.796692:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662277120:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201241.796715:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662277120:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.796721:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 152 00000100:00100000:3.0:1788201241.796731:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00100000:3.0:1788201241.796777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662276992:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201241.796804:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662276992:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 66us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.796809:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00080000:3.0:1788201241.796827:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201241.796832:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201241.796950:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662277376 00000100:00100000:0.0:1788201241.796974:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662277376 00000100:00100000:0.0:1788201241.797050:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:0.0:1788201241.797062:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662277376:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201241.797144:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662277376:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 85us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201241.797152:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:0.0:1788201241.797179:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662276736 00000100:00100000:0.0:1788201241.797184:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662276736 00000100:00100000:0.0:1788201241.797215:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 305 00000100:00100000:0.0:1788201241.797222:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662276736:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201241.797247:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662276736:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201241.797254:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 305 00000100:00080000:3.0:1788201241.797366:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201241.798261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201241.798305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201241.799455:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662277504 00000100:00100000:0.0:1788201241.799467:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662277504 00000100:00100000:0.0:1788201241.799536:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:0.0:1788201241.799546:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662277504:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201241.799613:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662277504:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 69us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201241.799619:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00080000:0.0:1788201241.799641:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201241.799766:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662277248 00000100:00100000:3.0:1788201241.799771:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662277248 00000100:00100000:3.0:1788201241.799826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 154 00000100:00100000:3.0:1788201241.799835:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662277248:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201241.799880:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662277248:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 47us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.799887:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 154 00000100:00080000:0.0:1788201241.800033:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201242.806253:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201243.254349:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681229568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201243.254473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201243.254608:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681229696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201243.254640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201243.255085:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681229568 00000100:00100000:2.0:1788201243.255097:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681229568 00000100:00100000:2.0:1788201243.255154:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681229696 00000100:00100000:2.0:1788201243.255157:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681229696 00000100:00100000:2.0:1788201243.255175:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201243.255184:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681229568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201243.255230:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201243.256141:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201243.256159:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681229696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201243.256192:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788201243.256282:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681229696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201243.256289:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201243.256350:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681229696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201243.258832:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681229568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3634us (4344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201243.258864:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681229568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201243.258878:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201243.766093:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681229824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201243.766199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201243.766306:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681229824 00000100:00100000:1.0:1788201243.766316:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681229824 00000100:00100000:1.0:1788201243.766402:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201243.766416:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681229824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201243.766453:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201243.766515:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681229824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201243.766523:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788201243.766572:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83716a00 x1875064681229824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201243.766595:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681229824:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201243.768770:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201243.770943:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201243.771107:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681229952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201243.771209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201243.771268:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681229952 00000100:00100000:3.0:1788201243.771280:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681229952 00000100:00080000:2.0:1788201243.771350:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201243.771358:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788201243.771371:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681229952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201243.771410:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201243.771477:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681229952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201243.771486:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788201243.772316:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf510700 x1875064681229952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201243.772342:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681229952:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201243.832196:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201244.582111:0:12500:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201244.582725:0:12500:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201244.854956:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201245.878369:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201246.327143:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681230080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201246.327233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.327492:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681230080 00000100:00100000:1.0:1788201246.327501:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681230080 00000100:00100000:1.0:1788201246.327632:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201246.327645:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681230080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201246.327681:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201246.327730:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681230080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.327784:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788201246.327958:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201246.327993:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83711500 x1875064681230080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201246.328013:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681230080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201246.332461:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681230336:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.332558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.332601:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681230848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.332625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.332644:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681231360:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.332665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.332695:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788201246.332701:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681230208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.332733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.332805:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681230720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.332831:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.332852:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681231232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.333104:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681230592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333133:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.333153:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681231104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.333193:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681231616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.333233:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201246.333239:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681230464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333276:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.333296:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681230976:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.333332:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681231488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333351:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.333388:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681230336 00000100:00100000:0.0:1788201246.333397:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681230336 00000100:00100000:0.0:1788201246.333445:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681230848 00000100:00100000:0.0:1788201246.333448:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681230848 00000100:00100000:0.0:1788201246.333475:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681231360 00000100:00100000:0.0:1788201246.333477:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681231360 00000100:00100000:0.0:1788201246.333489:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681230592 00000100:00100000:0.0:1788201246.333491:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681230592 00000100:00100000:0.0:1788201246.333502:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681230976 00000100:00100000:0.0:1788201246.333505:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681230976 00000100:00100000:0.0:1788201246.333517:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681231488 00000100:00100000:0.0:1788201246.333519:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681231488 00000100:00100000:0.0:1788201246.333535:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201246.333545:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681230336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333609:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681230336:12345-0@lo:400:kworker.0 Request processed in 65us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.333617:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201246.333634:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788201246.333640:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681230848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333665:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681230848:12345-0@lo:400:kworker.0 Request processed in 26us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.333670:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788201246.333679:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788201246.333693:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681231360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333723:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681231360:12345-0@lo:400:kworker.0 Request processed in 31us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.333728:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788201246.333768:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788201246.333774:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681230592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333814:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681230592:12345-0@lo:400:kworker.0 Request processed in 41us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.333820:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788201246.333831:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788201246.333837:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681230976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.333860:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681230976:12345-0@lo:400:kworker.0 Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.333866:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201246.333970:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681231232 00000100:00100000:1.0:1788201246.333974:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681231232 00000100:00100000:1.0:1788201246.334006:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681231104 00000100:00100000:1.0:1788201246.334009:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681231104 00000100:00100000:1.0:1788201246.334022:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681231616 00000100:00100000:1.0:1788201246.334025:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681231616 00000100:00100000:1.0:1788201246.334038:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201246.334045:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681231232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.334081:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681231232:12345-0@lo:400:kworker.0 Request processed in 37us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.334087:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201246.334100:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201246.334106:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681231104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.334142:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681231104:12345-0@lo:400:kworker.0 Request processed in 37us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.334149:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201246.334159:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201246.334165:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681231616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.334187:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681231616:12345-0@lo:400:kworker.0 Request processed in 23us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.334192:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201246.334309:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201246.334317:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681231488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.334349:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681231488:12345-0@lo:400:kworker.0 Request processed in 33us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.334355:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201246.334400:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681230208 00000100:00100000:0.0:1788201246.334404:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681230208 00000100:00100000:0.0:1788201246.334474:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788201246.334481:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681230208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.334515:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681230208:12345-0@lo:400:kworker.0 Request processed in 35us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.334532:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788201246.338274:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681230720 00000100:00100000:0.0:1788201246.338291:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681230720 00000100:00100000:0.0:1788201246.338456:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681230464 00000100:00100000:0.0:1788201246.338461:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681230464 00000100:00100000:2.0:1788201246.338507:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201246.338520:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681230720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201246.338649:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681230720:12345-0@lo:400:kworker.0 Request processed in 132us (5816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.338657:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201246.338680:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201246.338687:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681230464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201246.338720:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681230464:12345-0@lo:400:kworker.0 Request processed in 34us (5444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.338726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788201246.339193:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201246.339199:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201246.339203:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201246.339206:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201246.339508:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681230464:0@lo:400:kworker.0 00010000:00080000:0.0:1788201246.339531:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83716a00 x1875064681230976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201246.339543:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681230976:0@lo:400:kworker.0 00010000:00080000:0.0:1788201246.339558:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834ca680 x1875064681231488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201246.339566:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681231488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.339581:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681230592:0@lo:400:kworker.0 00010000:00080000:0.0:1788201246.339594:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c8a80 x1875064681231104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201246.339602:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681231104:0@lo:400:kworker.0 00010000:00080000:0.0:1788201246.339615:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834ca300 x1875064681231616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201246.339623:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681231616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.339677:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681230208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.339701:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681230720:0@lo:400:kworker.0 00010000:00080000:0.0:1788201246.339716:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c9500 x1875064681231232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201246.339725:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681231232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.339762:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681230336:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.339778:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681230848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.340004:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681231360:0@lo:400:kworker.0 00000020:00000004:1.0:1788201246.676190:0:12598:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201246.678927:0:12598:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201246.842472:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681231744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201246.842575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.843902:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681231744 00000100:00100000:0.0:1788201246.843916:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681231744 00000100:00100000:0.0:1788201246.844001:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201246.844013:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681231744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201246.844048:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201246.849888:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681231744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5861us (7296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.849905:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788201246.851613:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83408e00 x1875064681231744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201246.851658:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681231744:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201246.901968:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201246.918398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201246.918479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201246.918514:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201246.918545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201246.918569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201246.918588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201246.918616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201246.918649:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662278400 00000100:00100000:2.0:1788201246.918662:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662278400 00000100:00100000:2.0:1788201246.918781:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662278272 00000100:00100000:2.0:1788201246.918785:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662278272 00000100:00100000:2.0:1788201246.918815:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:2.0:1788201246.918827:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662278400:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201246.918917:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662278400:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 92us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.918924:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:2.0:1788201246.918959:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00100000:2.0:1788201246.918966:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662278272:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201246.919059:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662278272:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.919066:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00100000:2.0:1788201246.919090:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662277888 00000100:00100000:2.0:1788201246.919094:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662277888 00000100:00100000:2.0:1788201246.919124:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662278144 00000100:00100000:2.0:1788201246.919127:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662278144 00000100:00100000:2.0:1788201246.919138:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662277760 00000100:00100000:2.0:1788201246.919141:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662277760 00000100:00100000:2.0:1788201246.919153:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662278016 00000100:00100000:2.0:1788201246.919177:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662278016 00000100:00100000:2.0:1788201246.919197:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:2.0:1788201246.919204:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662277888:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201246.919236:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662277888:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.919243:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:2.0:1788201246.919255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:2.0:1788201246.919261:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662278144:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201246.919285:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662278144:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.919291:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:2.0:1788201246.919302:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:2.0:1788201246.919307:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662277760:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201246.919328:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662277760:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 21us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.919334:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:2.0:1788201246.919343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:2.0:1788201246.919348:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662278016:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201246.919379:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662278016:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.919385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:0.0:1788201246.926429:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662277632 00000100:00100000:0.0:1788201246.926449:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662277632 00000100:00100000:0.0:1788201246.926534:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 307 00000100:00100000:0.0:1788201246.926547:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662277632:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201246.926664:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662277632:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 119us (8281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.926672:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 307 00000100:00080000:0.0:1788201246.927236:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201246.927244:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201246.927248:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201246.927251:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201247.929105:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201248.377795:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201248.377825:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681231872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201248.378028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201248.378192:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681231872 00000100:00100000:2.0:1788201248.378203:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681231872 00000100:00100000:2.0:1788201248.378262:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201248.378273:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681231872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201248.378330:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788201248.381528:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681232000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201248.382469:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681231872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4191us (4435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201248.382482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201248.383026:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681231872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201248.385004:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201248.386288:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681232000 00000100:00100000:2.0:1788201248.386304:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681232000 00000100:00100000:2.0:1788201248.386492:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201248.386505:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681232000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201248.386556:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201248.388686:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681232000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2171us (3680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201248.388703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201248.388837:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681232000:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788201248.841544:0:12695:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201248.842005:0:12695:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201248.891114:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681232128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201248.891219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201248.891696:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681232256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201248.891731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201248.891860:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681232128 00000100:00100000:0.0:1788201248.891870:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681232128 00000100:00100000:0.0:1788201248.891931:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681232256 00000100:00100000:0.0:1788201248.891934:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681232256 00000100:00100000:0.0:1788201248.891953:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201248.891963:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681232128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201248.891997:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201248.892053:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681232128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201248.892060:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201248.892077:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201248.892095:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681232256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201248.892107:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201248.892135:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681232256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201248.892141:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788201248.892188:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b1f80 x1875064681232256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201248.892211:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681232256:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788201248.892242:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0000 x1875064681232128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201248.892253:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681232128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201248.892406:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201248.950402:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201249.976102:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201250.999875:0:12792:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201251.000130:0:12792:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201251.000977:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201251.448826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681232384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201251.448902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.449400:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681232384 00000100:00100000:2.0:1788201251.449409:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681232384 00000100:00100000:2.0:1788201251.449471:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201251.449482:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681232384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201251.449515:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201251.449565:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681232384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.449572:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788201251.449634:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12d500 x1875064681232384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201251.449674:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681232384:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201251.449923:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201251.452062:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681232640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.452166:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681233152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.452212:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681233664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201251.452245:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681232512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452269:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681232640 00000100:00100000:2.0:1788201251.452275:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681232640 00000100:00100000:2.0:1788201251.452328:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681233152 00000100:00100000:2.0:1788201251.452343:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681233152 00000100:00100000:2.0:1788201251.452369:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681233664 00000100:00100000:2.0:1788201251.452371:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681233664 00000100:00100000:2.0:1788201251.452387:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201251.452392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.452396:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681232640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201251.452418:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681233024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201251.452442:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.452443:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681232640:12345-0@lo:400:kworker.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.452450:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201251.452458:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681233536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452465:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788201251.452471:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681233152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201251.452479:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.452497:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681233152:12345-0@lo:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.452502:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788201251.452514:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201251.452519:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681233664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452563:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681233664:12345-0@lo:400:kworker.0 Request processed in 43us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.452569:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201251.452592:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681233024 00000100:00100000:2.0:1788201251.452595:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681233024 00000100:00100000:2.0:1788201251.452627:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788201251.452634:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681233024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452670:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681233024:12345-0@lo:400:kworker.0 Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.452676:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788201251.452693:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681233536 00000100:00100000:2.0:1788201251.452697:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681233536 00000100:00100000:2.0:1788201251.452725:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201251.452732:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681233536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452797:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681233536:12345-0@lo:400:kworker.0 Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.452802:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788201251.452821:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201251.452826:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201251.452860:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681232640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452871:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681233152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452881:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681233664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.452913:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681233024:0@lo:400:kworker.0 00010000:00080000:2.0:1788201251.452925:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550700 x1875064681233536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201251.452947:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681233536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453091:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681232896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.453145:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681233408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453166:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.453184:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681233920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.453222:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201251.453229:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681232768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.453266:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681233280:0@lo:400:kworker.0 00000100:00100000:1.0:1788201251.453280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681232896 00000100:00100000:1.0:1788201251.453285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681232896 00000100:00100000:1.0:1788201251.453312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201251.453319:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681232896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201251.453360:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681233792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201251.453360:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681232896:12345-0@lo:400:kworker.0 Request processed in 41us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201251.453367:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201251.453379:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681233280 00000100:00100000:2.0:1788201251.453381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201251.453382:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681233280 00000100:00100000:2.0:1788201251.453398:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681232896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201251.453401:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681233792 00000100:00100000:1.0:1788201251.453403:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681233792 00000100:00100000:1.0:1788201251.453416:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788201251.453417:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681233408 00000100:00100000:2.0:1788201251.453419:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681233408 00000100:00100000:1.0:1788201251.453421:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681233280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453440:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681233920 00000100:00100000:2.0:1788201251.453443:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681233920 00000100:00100000:1.0:1788201251.453454:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681233280:12345-0@lo:400:kworker.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.453460:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201251.453461:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788201251.453466:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681233408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201251.453470:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788201251.453476:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681233792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453497:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681233408:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201251.453497:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681233792:12345-0@lo:400:kworker.0 Request processed in 21us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.453502:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201251.453508:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788201251.453518:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201251.453525:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681233920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453553:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681233920:12345-0@lo:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.453559:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201251.453580:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681232768 00000100:00100000:2.0:1788201251.453583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681232768 00000100:00100000:2.0:1788201251.453610:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201251.453617:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681232768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201251.453646:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681232768:12345-0@lo:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.453652:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788201251.453672:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201251.453675:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201251.453678:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201251.453694:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681232768:0@lo:400:kworker.0 00010000:00080000:2.0:1788201251.453704:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf553b80 x1875064681233280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201251.453713:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681233280:0@lo:400:kworker.0 00010000:00080000:2.0:1788201251.453721:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550e00 x1875064681233792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201251.453729:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681233792:0@lo:400:kworker.0 00010000:00080000:2.0:1788201251.453756:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf551c00 x1875064681233408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201251.453764:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681233408:0@lo:400:kworker.0 00010000:00080000:2.0:1788201251.453783:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf550a80 x1875064681233920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201251.453791:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681233920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201251.455570:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681232512 00000100:00100000:0.0:1788201251.455580:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681232512 00000100:00100000:0.0:1788201251.455629:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788201251.455638:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681232512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201251.455724:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681232512:12345-0@lo:400:kworker.0 Request processed in 88us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201251.455733:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788201251.457350:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681232512:0@lo:400:kworker.0 00000100:00100000:1.0:1788201251.957969:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201251.957994:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681234048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201251.958067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201251.958143:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681234048 00000100:00100000:1.0:1788201251.958151:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681234048 00000100:00100000:1.0:1788201251.958200:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201251.958209:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681234048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201251.958233:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201251.958277:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681234048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201251.958284:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788201251.958324:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12d180 x1875064681234048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201251.958355:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681234048:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201252.026464:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201252.042841:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201252.042881:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662278528 00000100:00100000:3.0:1788201252.042889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201252.042892:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662278528 00000100:00100000:3.0:1788201252.042921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201252.042958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201252.042996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201252.043032:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201252.043061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201252.043105:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662278784 00000100:00100000:3.0:1788201252.043110:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662278784 00000100:00100000:3.0:1788201252.043165:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662279040 00000100:00100000:3.0:1788201252.043169:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662279040 00000100:00100000:3.0:1788201252.043193:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662278656 00000100:00100000:3.0:1788201252.043196:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662278656 00000100:00100000:3.0:1788201252.043212:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662278912 00000100:00100000:3.0:1788201252.043215:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662278912 00000100:00100000:3.0:1788201252.043233:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 171 00000100:00100000:3.0:1788201252.043244:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662278784:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201252.043322:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662278784:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 79us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.043338:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 171 00000100:00100000:3.0:1788201252.043357:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 172 00000100:00100000:3.0:1788201252.043364:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662279040:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201252.043392:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662279040:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.043398:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 172 00000100:00100000:3.0:1788201252.043412:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:1.0:1788201252.043421:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 309 00000100:00100000:3.0:1788201252.043422:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662278656:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201252.043438:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2398:x1875064662278528:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201252.043452:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662278656:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.043466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:1.0:1788201252.043478:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2398:x1875064662278528:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 44us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.043483:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:1.0:1788201252.043495:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 309 00000100:00100000:3.0:1788201252.043496:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662278912:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201252.043525:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662278912:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.043532:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:3.0:1788201252.043639:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662279168 00000100:00100000:3.0:1788201252.043644:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662279168 00000100:00100000:3.0:1788201252.043682:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662279296 00000100:00100000:3.0:1788201252.043685:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662279296 00000100:00100000:3.0:1788201252.043711:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201252.043718:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2397:x1875064662279168:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:3.0:1788201252.043767:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472036b 00000100:00080000:3.0:1788201252.043777:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9733000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201252.043824:0:8432:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788201252.043945:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1faf6d77-706d-41b4-9836-f216205de0f1+2:2397:x1875064662279168:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 226us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.043952:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201252.043966:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1788201252.043973:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2397:x1875064662279296:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:3.0:1788201252.043986:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720372 00000100:00080000:3.0:1788201252.043991:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ce0a64bd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201252.044016:0:8432:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788201252.044098:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1faf6d77-706d-41b4-9836-f216205de0f1+2:2397:x1875064662279296:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 124us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.044116:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00080000:3.0:1788201252.044142:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201252.044147:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201252.044150:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201252.044152:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788201252.044321:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201252.044340:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201253.046697:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201253.090567:0:12889:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201253.091033:0:12889:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788201253.493976:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681234176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201253.494051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201253.494632:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681234176 00000100:00100000:1.0:1788201253.494640:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681234176 00000100:00100000:1.0:1788201253.494704:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788201253.494713:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681234176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201253.494774:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201253.494830:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681234176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201253.494837:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788201253.494880:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681234176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201253.497559:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681234304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201253.497664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201253.497801:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681234304 00000100:00100000:0.0:1788201253.497810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681234304 00000100:00100000:0.0:1788201253.497860:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201253.497870:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681234304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201253.497904:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788201253.497957:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681234304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201253.497964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201253.498034:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681234304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201254.008488:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681234432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201254.008577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201254.008962:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681234560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201254.009000:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201254.013189:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681234432 00000100:00100000:3.0:1788201254.013207:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681234432 00000100:00100000:3.0:1788201254.013277:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681234560 00000100:00100000:3.0:1788201254.013280:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681234560 00000100:00100000:3.0:1788201254.013304:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201254.013329:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681234432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201254.013372:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201254.013491:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681234432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 176us (4911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201254.013499:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201254.013521:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201254.013528:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681234560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201254.013539:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201254.013575:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681234560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201254.013581:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788201254.013607:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201254.013653:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf553b80 x1875064681234560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201254.013687:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681234560:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788201254.013733:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf551c00 x1875064681234432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201254.013769:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681234432:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201254.072223:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201255.094470:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201256.119338:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201256.567034:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681234688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201256.567059:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681235072:0@lo:400:kworker.0 00000100:00100000:1.0:1788201256.567380:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681234944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.568407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201256.568414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201256.568492:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681235584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.568503:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681235200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201256.568531:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201256.568546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201256.568569:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681235712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201256.568594:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681234688 00000100:00100000:0.0:1788201256.568606:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681234688 00000100:00100000:0.0:1788201256.568671:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788201256.568682:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681234688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201256.568707:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681236096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201256.569336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201256.569346:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681234688:12345-0@lo:400:kworker.0 Request processed in 664us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201256.569357:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788201256.569373:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201256.569383:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681236224:0@lo:400:kworker.0 00000100:00100000:0.0:1788201256.569409:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681235200 00000100:00100000:2.0:1788201256.569413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201256.569416:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681235200 00000100:00100000:2.0:1788201256.569447:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681235072 00000100:00100000:2.0:1788201256.569460:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681235072 00000100:00100000:0.0:1788201256.569474:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788201256.569483:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681235200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201256.569501:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788201256.569512:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681235072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201256.569534:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681235200:12345-0@lo:400:kworker.0 Request processed in 52us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201256.569541:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201256.569581:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681235584 00000100:00100000:3.0:1788201256.569586:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681235584 00000100:00100000:2.0:1788201256.569674:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681235072:12345-0@lo:400:kworker.0 Request processed in 164us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201256.569681:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788201256.569703:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681236096 00000100:00100000:2.0:1788201256.569707:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681236096 00000100:00080000:0.0:1788201256.570923:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201256.570933:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201256.571009:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681236224 00000100:00100000:2.0:1788201256.571019:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681236224 00000100:00100000:0.0:1788201256.571074:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201256.571089:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681236096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201256.571243:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201256.571252:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681236224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201256.571255:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681236096:12345-0@lo:400:kworker.0 Request processed in 169us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201256.571265:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788201256.571290:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201256.571315:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681236224:12345-0@lo:400:kworker.0 Request processed in 64us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201256.571321:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201256.571383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788201256.571384:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b94c5880 x1875064681236224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201256.571402:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681236224:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571418:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201256.571425:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681235072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571432:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681235584:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788201256.571447:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b3480 x1875064681236096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201256.571457:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681236096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201256.571467:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681235456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571482:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681235584:12345-0@lo:400:kworker.0 Request processed in 55us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201256.571490:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1788201256.571498:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b2a00 x1875064681235584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201256.571510:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681235584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201256.571512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201256.571534:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681235968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571549:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681235456 00000100:00100000:3.0:1788201256.571555:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681235456 00000100:00100000:2.0:1788201256.571559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201256.571564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201256.571596:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681235968 00000100:00100000:1.0:1788201256.571599:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788201256.571600:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681235968 00000100:00100000:2.0:1788201256.571609:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681234688:0@lo:400:kworker.0 00000100:00100000:1.0:1788201256.571613:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681234816:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571629:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788201256.571631:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681235200:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571641:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681235456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201256.571643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201256.571663:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681235712 00000100:00100000:2.0:1788201256.571668:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681235712 00000100:00100000:1.0:1788201256.571671:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681235328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571689:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681235456:12345-0@lo:400:kworker.0 Request processed in 51us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201256.571702:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201256.571707:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788201256.571708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201256.571716:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681235712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571727:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681234816 00000100:00100000:1.0:1788201256.571730:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681235840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571732:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681234816 00000100:00100000:3.0:1788201256.571778:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681235328 00000100:00100000:3.0:1788201256.571782:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681235328 00000100:00100000:1.0:1788201256.571786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201256.571800:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681235840 00000100:00100000:2.0:1788201256.571802:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681235712:12345-0@lo:400:kworker.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201256.571805:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681235840 00000100:00100000:2.0:1788201256.571814:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201256.571818:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681236352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201256.571828:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788201256.571839:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681235968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201256.571844:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788201256.571850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201256.571857:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681234816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571889:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681235968:12345-0@lo:400:kworker.0 Request processed in 53us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201256.571897:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00010000:00080000:1.0:1788201256.571901:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b1c00 x1875064681235456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201256.571914:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788201256.571915:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681235456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571927:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681235328:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788201256.571932:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b3b80 x1875064681235968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201256.571942:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681235968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571968:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681235328:12345-0@lo:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201256.571969:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681235328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.571986:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788201256.572002:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788201256.572011:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681235840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201256.572019:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681236352 00000100:00100000:1.0:1788201256.572024:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681236352 00000100:00100000:3.0:1788201256.572049:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681235840:12345-0@lo:400:kworker.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201256.572056:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201256.572060:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788201256.572067:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681236352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201256.572106:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201256.572137:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681236352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201256.572143:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201256.572174:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681235840:0@lo:400:kworker.0 00010000:00080000:1.0:1788201256.572183:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12d180 x1875064681236352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201256.572198:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681236352:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201256.572239:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201256.572242:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201256.572244:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201256.572349:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681234816:12345-0@lo:400:kworker.0 Request processed in 494us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201256.572356:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:2.0:1788201256.572388:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b1500 x1875064681235712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201256.572398:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681235712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201256.572506:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681234816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201256.573478:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681234944 00000100:00100000:0.0:1788201256.573486:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681234944 00000100:00100000:0.0:1788201256.573565:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788201256.573574:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681234944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201256.573656:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681234944:12345-0@lo:400:kworker.0 Request processed in 83us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201256.573664:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788201256.573732:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681234944:0@lo:400:kworker.0 00000001:02000400:3.0:1788201256.613698:0:13035:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788201257.078216:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681236480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201257.078307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.078945:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681236480 00000100:00100000:1.0:1788201257.079019:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681236480 00000100:00100000:1.0:1788201257.079154:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201257.079178:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681236480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201257.079205:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201257.079267:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681236480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201257.079274:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788201257.079378:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e12d180 x1875064681236480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201257.079429:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681236480:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201257.142006:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201257.156647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201257.156697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201257.156787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201257.156826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201257.156861:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201257.156904:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662279424 00000100:00100000:3.0:1788201257.156915:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662279424 00000100:00100000:3.0:1788201257.156993:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 311 00000100:00100000:3.0:1788201257.157011:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662279424:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201257.157111:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662279552 00000100:00100000:0.0:1788201257.157124:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662279552 00000100:00100000:0.0:1788201257.157201:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662279808 00000100:00100000:0.0:1788201257.157204:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662279808 00000100:00100000:3.0:1788201257.157229:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662279424:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 220us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.157230:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662279680 00000100:00100000:0.0:1788201257.157237:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662279680 00000100:00100000:3.0:1788201257.157250:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 311 00000100:00100000:0.0:1788201257.157280:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662279936 00000100:00100000:0.0:1788201257.157285:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662279936 00000100:00100000:3.0:1788201257.157330:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:3.0:1788201257.157420:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662279552:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201257.157459:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662279552:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 121us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.159799:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:0.0:1788201257.159824:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662279808:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201257.159906:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662279808:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 88us (3209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.159914:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:0.0:1788201257.159948:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:0.0:1788201257.159957:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662279680:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201257.160114:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662279680:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 156us (3287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.160121:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:0.0:1788201257.160137:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:0.0:1788201257.160145:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662279936:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201257.160174:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662279936:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.160180:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00080000:0.0:1788201257.160205:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201257.160211:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201257.160866:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 181 00000001:00100000:1.0:1788201257.597572:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1faf6d77-706d-41b4-9836-f216205de0f1 00000020:00000080:1.0:1788201257.597583:0:8425:0:(genops.c:906:class_export_put()) final put ffff9ce0b9737000/1faf6d77-706d-41b4-9836-f216205de0f1 00000020:00000080:2.0:1788201257.597660:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9737000/1faf6d77-706d-41b4-9836-f216205de0f1 for lustre-OST0000 00000020:00000080:2.0:1788201257.597712:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b9733000 for lustre-OST0000 00000001:00100000:3.0:1788201257.598471:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1faf6d77-706d-41b4-9836-f216205de0f1 00000020:00000080:3.0:1788201257.598484:0:9511:0:(genops.c:906:class_export_put()) final put ffff9ce0a64bf000/1faf6d77-706d-41b4-9836-f216205de0f1 00000020:00000080:2.0:1788201257.598815:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a64bf000/1faf6d77-706d-41b4-9836-f216205de0f1 for lustre-OST0001 00000020:00000080:2.0:1788201257.598861:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a64bd800 for lustre-OST0001 00010000:00010000:1.0:1788201258.169205:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201258.613949:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201258.613982:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681236608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201258.614075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201258.614170:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681236608 00000100:00100000:1.0:1788201258.614180:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681236608 00000100:00100000:1.0:1788201258.614234:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201258.614244:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681236608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201258.614300:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201258.614354:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681236608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201258.614362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201258.614423:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681236608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201258.615319:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201258.615335:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681236736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201258.615382:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201258.615476:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681236736 00000100:00100000:0.0:1788201258.615483:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681236736 00000100:00100000:2.0:1788201258.615607:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788201258.615617:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681236736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201258.615645:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201258.615688:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681236736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.615695:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788201258.615765:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681236736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201259.127921:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201259.127946:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681236864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201259.128023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201259.128085:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681236864 00000100:00100000:1.0:1788201259.128093:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681236864 00000100:00100000:1.0:1788201259.128146:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788201259.128156:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681236864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201259.128204:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201259.128250:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681236864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201259.128257:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1788201259.128305:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333df80 x1875064681236864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201259.128324:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681236864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201259.128562:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201259.128598:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201259.128610:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681236992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201259.128643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201259.128709:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681236992 00000100:00100000:0.0:1788201259.128713:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681236992 00000100:00100000:0.0:1788201259.128777:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201259.128785:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681236992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201259.128798:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201259.128834:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681236992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201259.128848:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788201259.128929:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201259.128952:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b3100 x1875064681236992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201259.128966:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681236992:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201259.190004:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201259.345364:0:13182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2599df00 20000000:00000080:2.0:1788201259.345382:0:13182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cdf82525c00 uarg=0000000000000000 20000000:01000000:2.0:1788201259.345426:0:13182:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788201259.345431:0:13182:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788201259.345435:0:13182:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788201259.348006:0:13183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788201259.348446:0:13182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788201259.359951:0:13182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788201259.359985:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360019:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720309 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360028:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720317 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360035:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720325 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360043:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720333 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360054:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360061:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360069:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360112:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360129:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 12 pid: 6509 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.360145:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237120:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201259.360250:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360267:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 12 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.360291:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237248:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201259.360330:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720333 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360338:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720333 expref: 23 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.360386:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83408380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237376:0@lo:104: 00000100:00100000:2.0:1788201259.360431:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201259.360482:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720325 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360490:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720325 expref: 23 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.360499:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237504:0@lo:104: 00000100:00100000:2.0:1788201259.360522:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201259.360544:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720317 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.360551:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720317 expref: 23 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.360558:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237632:0@lo:104: 00000100:00100000:2.0:1788201259.360578:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201259.360606:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720309 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201259.360609:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681237376 00010000:00010000:2.0:1788201259.360618:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720309 expref: 23 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201259.360618:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681237376 00000100:00100000:2.0:1788201259.360631:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237760:0@lo:104: 00000100:00100000:2.0:1788201259.360659:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201259.360665:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681237504 00000100:00100000:1.0:1788201259.360669:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681237504 00000100:00100000:2.0:1788201259.360672:0:13182:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201259.360685:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681237632 00000100:00100000:1.0:1788201259.360689:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681237632 00000100:00100000:1.0:1788201259.360713:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681237760 00000100:00100000:1.0:1788201259.360716:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681237760 00000100:00100000:1.0:1788201259.360729:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201259.360761:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:13182:x1875064681237376:12345-0@lo:104: 00010000:00010000:1.0:1788201259.360774:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.360834:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201259.360841:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:13182:x1875064681237376:12345-0@lo:104: Request processed in 104us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201259.360849:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201259.360866:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201259.360872:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:13182:x1875064681237504:12345-0@lo:104: 00010000:00010000:1.0:1788201259.360887:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.360922:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201259.360927:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:13182:x1875064681237504:12345-0@lo:104: Request processed in 56us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201259.360933:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201259.360946:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201259.360951:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:13182:x1875064681237632:12345-0@lo:104: 00010000:00010000:1.0:1788201259.360959:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361007:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201259.361013:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:13182:x1875064681237632:12345-0@lo:104: Request processed in 62us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201259.361019:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201259.361031:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201259.361037:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:13182:x1875064681237760:12345-0@lo:104: 00010000:00010000:1.0:1788201259.361044:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361070:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788201259.361074:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:13182:x1875064681237760:12345-0@lo:104: Request processed in 38us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201259.361079:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788201259.361097:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201259.361103:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361116:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201259.361119:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361127:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201259.361134:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201259.361139:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201259.361157:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201259.361165:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361168:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.361180:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1519c20) 00010000:00010000:1.0:1788201259.361181:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1788201259.361187:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.361197:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361204:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201259.361205:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361221:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1200/0xf9b71aee44720333 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472033a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201259.361222:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201259.361241:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201259.361245:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.361248:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361253:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201259.361258:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.361259:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201259.361271:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.361300:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44720325 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472032c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361302:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201259.361318:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201259.361323:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201259.361337:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361343:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201259.361346:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201259.361351:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361359:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361375:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1400/0xf9b71aee44720317 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472031e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.361379:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201259.361385:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361387:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201259.361390:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201259.361392:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.361399:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.361400:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788201259.361410:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201259.361416:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788201259.361422:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681237888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201259.361441:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.361449:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201259.361456:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201259.361460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201259.361468:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0200/0xf9b71aee44720309 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.361484:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.361487:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201259.361488:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788201259.361489:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201259.362340:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681238272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201259.362379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201259.362416:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201259.362422:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681238144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201259.362456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201259.362610:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681237888 00000100:00100000:1.0:1788201259.362654:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681238016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201259.362684:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201259.362695:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681237888 00010000:00010000:3.0:1788201259.362726:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720333 expref: 24 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201259.362733:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681238272 00000100:00100000:1.0:1788201259.362752:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681238272 00010000:00010000:1.0:1788201259.362770:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720309 expref: 25 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201259.362790:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681238144 00000100:00100000:3.0:1788201259.362795:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681238144 00000100:00100000:1.0:1788201259.362796:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681238016 00000100:00100000:1.0:1788201259.362801:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681238016 00010000:00010000:3.0:1788201259.362812:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720317 expref: 27 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.362819:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720325 expref: 27 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201259.362832:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201259.362839:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201259.362844:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+27:3644:x1875064681237888:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201259.362851:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+27:3647:x1875064681238272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201259.362856:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201259.362862:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201259.362864:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720333 expref: 27 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.362870:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720309 expref: 27 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.362880:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720333 expref: 27 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201259.362938:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788201259.362946:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1788201259.363145:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83408380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237376:0@lo:104: 00000100:00100000:2.0:1788201259.363156:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237504:0@lo:104: 00000100:00100000:2.0:1788201259.363165:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237632:0@lo:104: 00000100:00100000:2.0:1788201259.363172:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237760:0@lo:104: 00000100:00100000:0.0:1788201259.363863:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788201259.363876:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201259.363886:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+27:3647:x1875064681238144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201259.363899:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201259.363905:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720317 expref: 27 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.365970:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720309 expref: 27 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.366000:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720310 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720309 expref: 27 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.366021:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201259.366119:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+26:3647:x1875064681238272:12345-0@lo:103:ldlm_bl.0 Request processed in 3270us (3738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201259.366129:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201259.366161:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788201259.366173:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201259.366185:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+25:3644:x1875064681238016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201259.366203:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201259.366209:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720325 expref: 25 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.366238:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720325 expref: 25 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.366250:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1a00/0xf9b71aee4472032c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720325 expref: 25 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.366260:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201259.366306:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681238016:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201259.366312:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201259.366361:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681238016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201259.368837:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472033a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720333 expref: 23 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.368859:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201259.368935:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3644:x1875064681237888:12345-0@lo:103:ldlm_bl.0 Request processed in 6094us (7475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201259.368945:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788201259.369062:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720317 expref: 21 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.369077:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472031e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720317 expref: 21 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.369086:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201259.369117:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:3647:x1875064681238144:12345-0@lo:103:ldlm_bl.0 Request processed in 5233us (6659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201259.369124:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201259.369172:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681238144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201259.369183:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681238272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201259.369370:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201259.369416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201259.369451:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662280064 00000100:00100000:2.0:1788201259.369459:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662280064 00010000:00010000:2.0:1788201259.369485:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 13 pid: 6509 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.369506:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662280192 00000100:00100000:2.0:1788201259.369509:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662280192 00010000:00010000:2.0:1788201259.369520:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 14 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.369537:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1788201259.369545:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+14:2399:x1875064662280064:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201259.369556:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201259.369569:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 14 pid: 6509 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.369580:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 14 pid: 6509 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.369591:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201259.369629:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+14:2399:x1875064662280064:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201259.369631:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681237888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201259.369641:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:1.0:1788201259.369665:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:1.0:1788201259.369675:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662280192:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201259.369684:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201259.369690:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 13 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369701:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 13 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369715:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.369722:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44720356 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf7e expref: 13 pid: 6509 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369726:0:13184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201259.369768:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237120:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201259.369780:0:13184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.369784:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee44720341 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf3f expref: 12 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369793:0:13184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369800:0:13184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369819:0:13184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201259.369825:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875064681237248:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201259.369829:0:13184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201259.369835:0:13184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369843:0:13184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369853:0:13184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.369864:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201259.369884:0:13182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201259.369885:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:2399:x1875064662280192:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 211us (468us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201259.369902:0:13182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.369973:0:13182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.369981:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720379 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201259.374072:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00010000:00010000:1.0:1788201260.214172:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201260.534254:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201260.534264:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cdf81977800 from 7 10000000:01000000:0.0:1788201260.534281:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201260.534348:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.534362:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.534393:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201260.534424:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.534520:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201260.534597:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201260.535119:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681238400 00000100:00100000:2.0:1788201260.535132:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681238400 00000100:00100000:2.0:1788201260.535282:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788201260.535295:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681238400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201260.535314:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201260.535333:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720380 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201260.535362:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720380 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201260.535374:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720380 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201260.535384:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0800, rc 0) 00000100:00100000:2.0:1788201260.535542:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681238400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201260.536247:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788201260.538221:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201260.538258:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.538286:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201260.538413:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.538485:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201260.538601:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201260.538657:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681238528 00000100:00100000:2.0:1788201260.539302:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681238528 00000100:00100000:3.0:1788201260.539591:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788201260.539606:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681238528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201260.539816:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681238528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201260.539824:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788201260.539890:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201260.539951:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201260.540003:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201260.540394:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681238656 00000100:00100000:2.0:1788201260.540411:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681238656 00000100:00100000:3.0:1788201260.540476:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2ef900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201260.540530:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788201260.540545:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681238656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201260.541091:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681238656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 548us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201260.541100:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788201260.541135:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201260.544527:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201260.545177:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201260.545211:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201260.545227:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201260.545249:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201260.545261:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201260.545264:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b95bd800 from 7 10000000:01000000:1.0:1788201260.545277:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201260.545327:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201260.545337:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201260.545350:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201260.545383:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201260.545469:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201260.545529:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201260.545592:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681238784 00000100:00100000:0.0:1788201260.545601:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681238784 00000100:00100000:0.0:1788201260.545662:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788201260.545673:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681238784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201260.545691:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201260.545706:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472038e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.545854:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472038e expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.545865:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472038e expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.545875:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75200, rc 0) 00000100:00100000:0.0:1788201260.548392:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681238784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2705us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201260.548406:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788201260.548688:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201260.548721:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201260.548735:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201260.557039:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.557146:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201260.557197:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201260.557344:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681238912 00000100:00100000:3.0:1788201260.557354:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681238912 00000100:00100000:3.0:1788201260.557428:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788201260.557440:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681238912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201260.557627:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681238912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201260.557636:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788201260.558013:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681238912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201260.558068:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201260.558126:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201260.558160:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201260.558212:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681239040 00000100:00100000:0.0:1788201260.558218:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681239040 00000100:00100000:0.0:1788201260.558257:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788201260.558266:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681239040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.558387:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681239040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201260.558395:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788201260.558523:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201260.559439:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788201260.568049:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788201260.568117:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201260.568134:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.568149:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201260.568217:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201260.568222:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce09e1da800 from 7 10000000:01000000:0.0:1788201260.568225:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201260.568291:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.568301:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.568315:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201260.568349:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.568438:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201260.568491:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201260.568563:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681239168 00000100:00100000:3.0:1788201260.568572:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681239168 00000100:00100000:3.0:1788201260.568637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788201260.568649:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681239168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201260.568666:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201260.568681:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472039c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201260.568725:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472039c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201260.568782:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472039c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201260.568793:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb400, rc 0) 00000100:00100000:3.0:1788201260.568838:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681239168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201260.568845:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788201260.569078:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201260.569097:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.569107:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201260.569180:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.569211:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201260.569846:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201260.572159:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681239296 00000100:00100000:3.0:1788201260.572181:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681239296 00000100:00100000:3.0:1788201260.572324:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788201260.572337:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681239296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201260.572559:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681239296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (3346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201260.572581:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788201260.572676:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201260.572804:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201260.572860:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201260.577019:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201260.581896:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681239424 00000100:00100000:0.0:1788201260.581917:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681239424 00000100:00100000:0.0:1788201260.582011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788201260.582025:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681239424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.582291:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681239424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 268us (9429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201260.582300:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788201260.583417:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201260.587897:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788201260.587976:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788201260.588005:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201260.588020:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.588034:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201260.588047:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201260.588052:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0889be000 from 7 10000000:01000000:0.0:1788201260.588055:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201260.588189:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.588199:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.588212:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201260.588247:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.588358:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201260.588430:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201260.588455:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681239552 00000100:00100000:0.0:1788201260.588464:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681239552 00000100:00100000:0.0:1788201260.588525:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788201260.588535:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681239552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201260.588551:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201260.588567:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447203aa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.588597:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447203aa expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.588609:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447203aa expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.588619:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce080031000, rc 0) 00000100:00100000:0.0:1788201260.588659:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681239552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201260.588666:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788201260.588718:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201260.588735:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.588774:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201260.588832:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.588862:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201260.588888:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201260.588901:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681239680 00000100:00100000:0.0:1788201260.588904:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681239680 00000100:00100000:0.0:1788201260.588922:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788201260.588927:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681239680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.589058:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681239680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201260.589065:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788201260.589094:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.592357:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201260.592470:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201260.592526:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201260.592844:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681239808 00000100:00100000:3.0:1788201260.592853:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681239808 00000100:00100000:3.0:1788201260.592915:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788201260.592926:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681239808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201260.593365:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681239808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 439us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201260.593374:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788201260.593473:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681239808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201260.596809:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788201260.597072:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788201260.597103:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201260.597114:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201260.597128:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201261.244489:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201261.315038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201261.315424:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662280320 00000100:00100000:2.0:1788201261.315433:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662280320 00000100:00100000:2.0:1788201261.315503:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 324 00000100:00100000:2.0:1788201261.315514:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:6171:x1875064662280320:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201261.315532:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201261.315551:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201261.315582:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201261.315594:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201261.315604:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1400, rc 0) 00000100:00100000:2.0:1788201261.315669:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662280320:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 157us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.315677:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 324 00000100:00100000:2.0:1788201261.323818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201261.323856:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662280448 00000100:00100000:2.0:1788201261.323866:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662280448 00000100:00100000:2.0:1788201261.323956:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 325 00000100:00100000:2.0:1788201261.323967:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662280448:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201261.324139:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662280448:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 174us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.324148:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 325 00000100:00100000:2.0:1788201261.327919:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201261.327947:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662280576 00000100:00100000:2.0:1788201261.327955:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662280576 00000100:00100000:2.0:1788201261.327996:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 326 00000100:00100000:2.0:1788201261.328005:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662280576:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201261.330504:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662280576:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 2490us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.330518:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 326 00000100:00100000:1.0:1788201261.353596:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201261.353892:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662280704 00000100:00100000:3.0:1788201261.353903:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662280704 00000100:00100000:3.0:1788201261.353973:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 327 00000100:00100000:3.0:1788201261.353985:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662280704:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201261.354004:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201261.354023:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfb6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201261.354053:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201261.354079:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201261.354090:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbe00, rc 0) 00000100:00100000:3.0:1788201261.354161:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662280704:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 177us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201261.354169:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 327 00000100:00100000:3.0:1788201261.357675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201261.357898:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662280832 00000100:00100000:0.0:1788201261.357908:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662280832 00000100:00100000:0.0:1788201261.357955:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 328 00000100:00100000:0.0:1788201261.357965:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662280832:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201261.358430:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662280832:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 465us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201261.358447:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 328 00000100:00100000:3.0:1788201261.363878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201261.363933:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662280960 00000100:00100000:0.0:1788201261.363944:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662280960 00000100:00100000:0.0:1788201261.364006:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 329 00000100:00100000:0.0:1788201261.364016:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662280960:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201261.364164:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662280960:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 149us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201261.364173:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 329 00000100:00100000:1.0:1788201261.688765:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201261.688789:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681239936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201261.690170:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201261.691511:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681239936 00000100:00100000:1.0:1788201261.691525:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681239936 00000100:00100000:1.0:1788201261.691615:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788201261.691629:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681239936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201261.691667:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201261.691775:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681239936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201261.691782:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788201261.691807:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201261.691841:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333e680 x1875064681239936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201261.691857:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681239936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201261.694102:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681240448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.694215:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.694256:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681240960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.694294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.694318:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681241472:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.694338:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.694362:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201261.694368:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681240064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.694396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.694426:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681240576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.697998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.698044:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681241088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.698130:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681240192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.698179:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681240704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201261.698189:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681240448 00000100:00100000:3.0:1788201261.698197:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681240448 00000100:00100000:2.0:1788201261.698201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.698218:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681241216:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201261.698245:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681240192 00000100:00100000:3.0:1788201261.698248:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681240192 00000100:00100000:2.0:1788201261.698257:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201261.698258:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681240704 00000100:00100000:3.0:1788201261.698273:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681240704 00000100:00100000:2.0:1788201261.698275:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681240320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201261.698293:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681241216 00000100:00100000:3.0:1788201261.698295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681241216 00000100:00100000:2.0:1788201261.698296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.698313:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681240832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201261.698322:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788201261.698329:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681240448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698333:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201261.698342:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681241344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201261.698424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681240576 00000100:00100000:1.0:1788201261.698434:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681240576 00000100:00100000:1.0:1788201261.698457:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681240320 00000100:00100000:1.0:1788201261.698460:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681240320 00000100:00100000:1.0:1788201261.698471:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788201261.698476:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681240576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698528:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681240832 00000100:00100000:3.0:1788201261.698529:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681240448:12345-0@lo:400:kworker.0 Request processed in 200us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.698531:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681240832 00000100:00100000:3.0:1788201261.698536:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201261.698550:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681241344 00000100:00100000:3.0:1788201261.698552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788201261.698552:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681241344 00000100:00100000:3.0:1788201261.698557:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681240192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698565:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788201261.698570:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681240704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201261.698589:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681240192:12345-0@lo:400:kworker.0 Request processed in 31us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201261.698595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788201261.698596:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681240704:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.698601:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788201261.698613:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788201261.698617:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788201261.698619:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681241216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698622:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681240832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201261.698643:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681241216:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.698643:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681240832:12345-0@lo:400:kworker.0 Request processed in 20us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.698649:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788201261.698652:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788201261.698659:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788201261.698664:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681241344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.698690:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681241344:12345-0@lo:400:kworker.0 Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.698695:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788201261.698711:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681240960 00000100:00100000:2.0:1788201261.698715:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681240960 00000100:00100000:2.0:1788201261.698762:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681241472 00000100:00100000:2.0:1788201261.698766:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681241472 00000100:00100000:2.0:1788201261.698778:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681241088 00000100:00100000:2.0:1788201261.698780:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681241088 00000100:00100000:2.0:1788201261.698792:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201261.698798:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681240960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201261.698942:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201261.698950:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681241472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201261.703591:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681241472:12345-0@lo:400:kworker.0 Request processed in 4632us (9241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201261.703605:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201261.703644:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788201261.703660:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681241088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201261.703727:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681241088:12345-0@lo:400:kworker.0 Request processed in 76us (5628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201261.703733:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201261.703918:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681240960:12345-0@lo:400:kworker.0 Request processed in 5117us (9620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.703926:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201261.703960:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681240064 00000100:00100000:2.0:1788201261.703968:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681240064 00000100:00100000:1.0:1788201261.704066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681240576:12345-0@lo:400:kworker.0 Request processed in 5587us (6074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201261.704076:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788201261.704097:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788201261.704105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681240320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201261.704141:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681240320:12345-0@lo:400:kworker.0 Request processed in 38us (5844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201261.704147:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1788201261.704165:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201261.704170:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201261.704173:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201261.704177:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201261.704229:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788201261.704237:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681240064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.704283:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681240064:12345-0@lo:400:kworker.0 Request processed in 47us (9886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201261.704300:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788201261.704525:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681240320:0@lo:400:kworker.0 00010000:00080000:2.0:1788201261.704541:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b0e00 x1875064681240832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201261.704550:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681240832:0@lo:400:kworker.0 00010000:00080000:2.0:1788201261.704562:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c1880 x1875064681241344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201261.704570:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681241344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.704581:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681240192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.704592:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681240704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.704603:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681241216:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.704646:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681240064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.704657:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681240576:0@lo:400:kworker.0 00010000:00080000:2.0:1788201261.704667:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c3480 x1875064681241088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201261.704675:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681241088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201261.704687:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681240448:0@lo:400:kworker.0 00010000:00080000:2.0:1788201261.704697:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c0a80 x1875064681240960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201261.704704:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681240960:0@lo:400:kworker.0 00010000:00080000:2.0:1788201261.704723:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c3800 x1875064681241472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201261.704731:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681241472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.199393:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201262.199417:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681241600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201262.199483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201262.199574:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681241600 00000100:00100000:1.0:1788201262.199581:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681241600 00000100:00100000:1.0:1788201262.199625:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201262.199633:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681241600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201262.199655:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201262.199696:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681241600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201262.199704:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1788201262.199773:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333e680 x1875064681241600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201262.199792:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681241600:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201262.262818:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201262.274986:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201262.275030:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201262.275074:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201262.275094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201262.275295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662281216 00000100:00100000:0.0:1788201262.275305:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662281216 00000100:00100000:0.0:1788201262.275370:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662281472 00000100:00100000:0.0:1788201262.275373:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662281472 00000100:00100000:0.0:1788201262.275389:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662281344 00000100:00100000:0.0:1788201262.275392:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662281344 00000100:00100000:0.0:1788201262.275410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:0.0:1788201262.275420:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2401:x1875064662281216:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201262.275493:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2401:x1875064662281216:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 75us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.275500:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:0.0:1788201262.275516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:0.0:1788201262.275523:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662281472:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201262.275548:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662281472:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.275555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:0.0:1788201262.275576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:0.0:1788201262.275583:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662281344:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201262.275608:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662281344:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.275614:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:0.0:1788201262.275636:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662281088 00000100:00100000:0.0:1788201262.275639:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662281088 00000100:00100000:0.0:1788201262.275666:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 331 00000100:00100000:0.0:1788201262.275673:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662281088:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201262.275699:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662281088:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.275705:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 331 00000100:00080000:0.0:1788201262.275731:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201262.275735:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201262.276455:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201262.276491:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662281600 00000100:00100000:2.0:1788201262.276495:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662281600 00000100:00100000:2.0:1788201262.276532:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:2.0:1788201262.276539:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662281600:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201262.276583:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662281600:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 45us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201262.276590:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00080000:2.0:1788201262.276637:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788201263.286058:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201263.292801:0:13383:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788201263.736808:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681241728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201263.736888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201263.737337:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681241728 00000100:00100000:1.0:1788201263.737345:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681241728 00000100:00100000:1.0:1788201263.737408:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788201263.737427:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681241728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201263.737460:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201263.737517:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681241728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201263.737526:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201263.737853:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681241728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201263.738037:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681241856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201263.738079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201263.738213:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681241856 00000100:00100000:3.0:1788201263.738219:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681241856 00000100:00100000:3.0:1788201263.738268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788201263.738276:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681241856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201263.738298:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201263.738342:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681241856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201263.738348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788201263.738651:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681241856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201264.246121:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201264.246145:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681241984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201264.246221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201264.246441:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681241984 00000100:00100000:2.0:1788201264.246450:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681241984 00000100:00100000:2.0:1788201264.246538:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201264.246549:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681241984:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201264.246553:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201264.246566:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681242112:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201264.246586:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201264.246632:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681241984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201264.246638:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1788201264.246705:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0700 x1875064681241984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201264.246723:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681241984:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788201264.246816:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201264.247848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201264.248394:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681242112 00000100:00100000:2.0:1788201264.248402:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681242112 00000100:00100000:2.0:1788201264.248470:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201264.248480:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681242112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201264.248499:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201264.248557:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681242112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201264.248563:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788201264.248632:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201264.250043:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b94c6680 x1875064681242112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201264.250066:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681242112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201264.309907:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201265.334027:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201266.357919:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201266.806716:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201266.806763:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681242240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201266.806834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201266.807510:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681242752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.807545:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201266.807566:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681243264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.807590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201266.807607:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681243776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.807626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201266.807656:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201266.807663:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681242368:0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.807690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201266.807711:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681242880:0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.807725:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681242240 00000100:00100000:0.0:1788201266.807733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201266.807734:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681242240 00000100:00100000:0.0:1788201266.807771:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681243392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.807791:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201266.807809:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201266.807811:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681242496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.807819:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681242240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201266.807834:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788201266.807847:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201266.807849:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681243008:0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.807868:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201266.807885:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681243520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.807896:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681242240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201266.807902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201266.807904:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201266.807917:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788201266.807922:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681242624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.807943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201266.807958:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681243136:0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.807968:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681242880 00000100:00100000:1.0:1788201266.807972:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681242880 00000100:00100000:0.0:1788201266.807977:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201266.807992:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681243648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.807993:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681242624 00000100:00100000:1.0:1788201266.808001:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681242624 00000100:00100000:0.0:1788201266.808011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201266.808028:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201266.808029:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201266.808036:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681242880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.808039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681242752 00000100:00100000:0.0:1788201266.808041:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681242752 00000100:00100000:0.0:1788201266.808061:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681242496 00000100:00100000:0.0:1788201266.808064:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681242496 00000100:00100000:1.0:1788201266.808072:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681242880:12345-0@lo:400:kworker.0 Request processed in 38us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201266.808075:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681243008 00000100:00100000:1.0:1788201266.808078:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788201266.808082:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681243008 00000100:00100000:1.0:1788201266.808089:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788201266.808094:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681242624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.808100:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681243520 00000100:00100000:0.0:1788201266.808102:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681243520 00000100:00100000:0.0:1788201266.808115:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681243136 00000100:00100000:0.0:1788201266.808117:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681243136 00000100:00100000:1.0:1788201266.808123:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681242624:12345-0@lo:400:kworker.0 Request processed in 30us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201266.808128:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681243648 00000100:00100000:1.0:1788201266.808129:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788201266.808130:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681243648 00000100:00100000:1.0:1788201266.808144:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681243264 00000100:00100000:0.0:1788201266.808145:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788201266.808146:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681243264 00000100:00100000:0.0:1788201266.808150:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681242752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.808164:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681243776 00000100:00100000:1.0:1788201266.808166:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681243776 00000100:00100000:1.0:1788201266.808177:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681243392 00000100:00100000:1.0:1788201266.808179:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681243392 00000100:00100000:0.0:1788201266.808179:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681242752:12345-0@lo:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201266.808184:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788201266.808191:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201266.808196:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681243264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.808197:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788201266.808202:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681242496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.808233:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681243264:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201266.808234:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681242496:12345-0@lo:400:kworker.0 Request processed in 20us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201266.808241:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201266.808241:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788201266.808253:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201266.808253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788201266.808260:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681243776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.808260:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681243008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.808285:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681243776:12345-0@lo:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201266.808285:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681243008:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201266.808292:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201266.808292:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788201266.808302:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788201266.808306:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788201266.808308:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681243520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.808311:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681243392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.808331:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681243392:12345-0@lo:400:kworker.0 Request processed in 20us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201266.808331:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681243520:12345-0@lo:400:kworker.0 Request processed in 24us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201266.808338:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788201266.808338:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788201266.808352:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788201266.808358:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681243136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201266.808414:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681242368 00000100:00100000:2.0:1788201266.808418:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681242368 00000100:00100000:2.0:1788201266.808447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788201266.808453:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681242368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201266.808487:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681242368:12345-0@lo:400:kworker.0 Request processed in 35us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201266.808493:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00080000:2.0:1788201266.808543:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333f800 x1875064681242240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201266.808569:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681242240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201266.808641:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681243136:12345-0@lo:400:kworker.0 Request processed in 282us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201266.812430:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788201266.812458:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681243648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.812559:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681243648:12345-0@lo:400:kworker.0 Request processed in 116us (4546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201266.812566:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:1.0:1788201266.812620:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201266.812625:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201266.812628:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201266.812632:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201266.812668:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681242624:0@lo:400:kworker.0 00010000:00080000:1.0:1788201266.812685:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c8700 x1875064681243136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201266.812696:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681243136:0@lo:400:kworker.0 00010000:00080000:1.0:1788201266.812707:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834ca680 x1875064681243648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201266.812715:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681243648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.812727:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681242496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.812754:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681243008:0@lo:400:kworker.0 00000100:00100000:1.0:1788201266.812766:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681243520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201266.814565:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788201266.814821:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681242368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201266.814839:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681242880:0@lo:400:kworker.0 00010000:00080000:2.0:1788201266.814854:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834ca300 x1875064681243392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201266.814863:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681243392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201266.814877:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681242752:0@lo:400:kworker.0 00010000:00080000:2.0:1788201266.814888:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0834c9500 x1875064681243264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201266.814895:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681243264:0@lo:400:kworker.0 00010000:00080000:2.0:1788201266.814905:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83717480 x1875064681243776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201266.814912:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681243776:0@lo:400:kworker.0 00000100:00100000:2.0:1788201267.318006:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681243904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201267.318077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201267.318277:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681243904 00000100:00100000:1.0:1788201267.318285:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681243904 00000100:00100000:1.0:1788201267.318343:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201267.318355:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681243904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201267.318378:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201267.318438:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681243904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.318444:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788201267.318801:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333ce00 x1875064681243904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.318877:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681243904:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201267.382005:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201267.400925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201267.400968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201267.400997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201267.401020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201267.401081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201267.401162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662281984 00000100:00100000:2.0:1788201267.401171:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662281984 00000100:00100000:2.0:1788201267.401239:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662282240 00000100:00100000:2.0:1788201267.401242:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662282240 00000100:00100000:2.0:1788201267.401254:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662281856 00000100:00100000:2.0:1788201267.401256:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662281856 00000100:00100000:2.0:1788201267.401281:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662282112 00000100:00100000:2.0:1788201267.401283:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662282112 00000100:00100000:2.0:1788201267.401297:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 201 00000100:00100000:2.0:1788201267.401306:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662281984:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201267.401376:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662281984:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 71us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.401382:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 201 00000100:00100000:2.0:1788201267.401398:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 202 00000100:00100000:2.0:1788201267.401404:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662282240:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201267.401422:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662282240:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 19us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.401427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 202 00000100:00100000:2.0:1788201267.401436:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00100000:2.0:1788201267.401441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662281856:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201267.401456:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662281856:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 16us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.401461:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00100000:2.0:1788201267.401469:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:2.0:1788201267.401474:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662282112:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201267.401490:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662282112:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 15us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.401495:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:3.0:1788201267.401779:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662281728 00000100:00100000:3.0:1788201267.401784:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662281728 00000100:00100000:3.0:1788201267.401819:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 333 00000100:00100000:3.0:1788201267.401827:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662281728:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201267.401867:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662281728:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 42us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.401873:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 333 00000100:00080000:0.0:1788201267.403166:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201267.403174:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201268.407236:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201268.551564:0:13533:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:34:26 (1788201266) === 00000100:00100000:2.0:1788201268.855832:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681244160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201268.855911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201268.855996:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201268.856003:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681244032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201268.856029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201268.856056:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681244160 00000100:00100000:3.0:1788201268.856127:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681244160 00000100:00100000:3.0:1788201268.856184:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681244032 00000100:00100000:3.0:1788201268.856188:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681244032 00000100:00100000:3.0:1788201268.856206:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788201268.856229:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681244160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201268.856262:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788201268.856313:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681244160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201268.856321:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788201268.856337:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788201268.856343:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681244032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201268.856359:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201268.856383:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681244032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.856388:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681244160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201268.856389:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788201268.856409:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681244032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201268.860676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201268.860727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201268.860798:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662282496 00000100:00100000:3.0:1788201268.860832:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662282496 00000100:00100000:3.0:1788201268.860982:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1788201268.860997:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:10496:x1875064662282496:12345-192.168.203.2@tcp:700:mkdir.0 00000100:00100000:3.0:1788201268.861111:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:10496:x1875064662282496:12345-192.168.203.2@tcp:700:mkdir.0 Request processed in 108us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201268.861630:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662282368 00000100:00100000:2.0:1788201268.861636:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662282368 00000100:00100000:2.0:1788201268.861679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:2.0:1788201268.861687:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2401:x1875064662282368:12345-192.168.203.2@tcp:41:mkdir.0 00000004:00000024:2.0:1788201268.861708:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201268.861811:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2401:x1875064662282368:12345-192.168.203.2@tcp:41:mkdir.0 Request processed in 115us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201268.861819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201268.871483:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1788201268.872254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201268.884544:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662282752 00000100:00100000:2.0:1788201268.884558:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662282752 00000100:00100000:2.0:1788201268.884635:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:2.0:1788201268.884645:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:10496:x1875064662282752:12345-192.168.203.2@tcp:36:mkdir.0 00010000:00010000:2.0:1788201268.884700:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201268.884799:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720268 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf2a expref: 6 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.884819:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0a1883d00) 00010000:00010000:2.0:1788201268.884830:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201268.884925:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.884939:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.884949:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.896421:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.896445:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.896459:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899430:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899451:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899464:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201268.899480:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fc6fb7c reply state 00000000caa28372 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899492:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899499:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb200) 00010000:00010000:2.0:1788201268.899503:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201268.899506:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788201268.899511:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788201268.899519:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899526:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899544:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899551:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201268.899556:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899564:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899574:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb700) 00010000:00010000:2.0:1788201268.899577:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201268.899581:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.899587:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201268.905588:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fc6fb7c reply state 00000000caa28372 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.905627:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.905636:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ce085edbc00) 00010000:00010000:2.0:1788201268.905640:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201268.905645:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788201268.905784:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:10496:x1875064662282752:12345-192.168.203.2@tcp:36:mkdir.0 Request processed in 21136us (33527us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788201268.905793:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:1.0:1788201268.919515:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201268.919624:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662282880 00000100:00100000:2.0:1788201268.919635:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662282880 00000100:00100000:2.0:1788201268.919696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1788201268.919707:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:10498:x1875064662282880:12345-192.168.203.2@tcp:101:chmod.0 00010000:00010000:2.0:1788201268.919727:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201268.919782:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfbd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.919857:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447203e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.920163:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447203e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.920176:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447203e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201268.920295:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201268.920302:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201268.920347:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447203e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.920378:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447203db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfbd expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.920400:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447203e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfbd expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.920410:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb700) 00010000:00010000:3.0:1788201268.920413:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201268.920416:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0c00, rc 0) 00000100:00100000:3.0:1788201268.920478:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+8:10498:x1875064662282880:12345-192.168.203.2@tcp:101:chmod.0 Request processed in 773us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201268.920486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1788201268.930334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201268.930578:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662283136 00000100:00100000:2.0:1788201268.930588:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662283136 00000100:00100000:2.0:1788201268.930654:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1788201268.930665:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:10498:x1875064662283136:12345-192.168.203.2@tcp:36:chmod.0 00010000:00010000:2.0:1788201268.930717:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201268.930782:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447203e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfbd expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.930801:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb700) 00010000:00010000:2.0:1788201268.930812:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201268.931088:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.931102:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.931129:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201268.931333:0:8476:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000017617e8 reply state 00000000e129d647 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.931346:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.931352:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb000) 00010000:00010000:3.0:1788201268.931355:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788201268.931357:0:8476:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788201268.931364:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788201268.931488:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+9:10498:x1875064662283136:12345-192.168.203.2@tcp:36:chmod.0 Request processed in 824us (1161us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788201268.931495:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1788201268.987460:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201268.991612:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662283264 00000100:00100000:2.0:1788201268.991628:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662283264 00000100:00100000:2.0:1788201268.991709:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:2.0:1788201268.991720:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+9:10500:x1875064662283264:12345-192.168.203.2@tcp:101:chown.0 00010000:00010000:2.0:1788201268.991769:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201268.991791:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447203f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfc4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.991857:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee447203f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.992264:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee447203f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.992277:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee447203f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201268.992329:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201268.992334:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201268.992370:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee447203f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.992397:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447203f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfc4 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.992415:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee447203f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfc4 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201268.992423:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb000) 00010000:00010000:2.0:1788201268.992426:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201268.992429:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0200, rc 0) 00000100:00100000:2.0:1788201268.992549:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+10:10500:x1875064662283264:12345-192.168.203.2@tcp:101:chown.0 Request processed in 831us (5099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201268.992564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:1.0:1788201269.000351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201269.000471:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662283392 00000100:00100000:3.0:1788201269.000481:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662283392 00000100:00100000:3.0:1788201269.000545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1788201269.000555:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+10:10500:x1875064662283392:12345-192.168.203.2@tcp:101:chown.0 00010000:00010000:3.0:1788201269.000580:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201269.000610:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447203fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfcb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.000679:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.000696:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.000725:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.000773:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.000781:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.000788:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.001102:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.001111:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005626:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201269.005706:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201269.005711:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201269.005751:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005767:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005774:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005799:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005805:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201269.005810:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005817:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005831:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb000) 00010000:00010000:3.0:1788201269.005834:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201269.005839:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005846:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005961:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005968:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005973:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005979:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bae00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201269.005982:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.005999:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.006008:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ce085edbc00) 00010000:00010000:3.0:1788201269.006010:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201269.006013:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.006019:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472040c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.006059:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447203fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfcb expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.006074:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfcb expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.006081:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb200) 00010000:00010000:3.0:1788201269.006083:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201269.006085:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201269.006309:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+11:10500:x1875064662283392:12345-192.168.203.2@tcp:101:chown.0 Request processed in 5753us (5965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201269.006319:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1788201269.026957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201269.027113:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662283520 00000100:00100000:2.0:1788201269.027134:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662283520 00000100:00100000:2.0:1788201269.027388:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1788201269.027401:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da566c69-17bd-4938-bc1e-8b9ba2633293+11:10500:x1875064662283520:12345-192.168.203.2@tcp:900:chown.0 00000100:00100000:2.0:1788201269.027488:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da566c69-17bd-4938-bc1e-8b9ba2633293+11:10500:x1875064662283520:12345-192.168.203.2@tcp:900:chown.0 Request processed in 90us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201269.027496:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00080000:0.0:1788201269.028127:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201269.036855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201269.037025:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662283776 00000100:00100000:3.0:1788201269.037034:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662283776 00000100:00100000:3.0:1788201269.037087:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:3.0:1788201269.037096:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+11:10500:x1875064662283776:12345-192.168.203.2@tcp:36:chown.0 00010000:00010000:3.0:1788201269.037152:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201269.037188:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfcb expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.037206:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb200) 00010000:00010000:3.0:1788201269.037219:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201269.037240:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.037253:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.037262:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201269.044353:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1788201269.045139:0:8476:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007450f917 reply state 00000000ace7fbe2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.045175:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.045186:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb200) 00010000:00010000:1.0:1788201269.045190:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788201269.045195:0:8476:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788201269.045217:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788201269.045317:0:8476:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788201269.045348:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+9:10500:x1875064662283776:12345-192.168.203.2@tcp:36:chown.0 Request processed in 8249us (8497us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788201269.045357:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00010000:00010000:3.0:1788201269.047203:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047227:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047234:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047240:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201269.047245:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047252:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047267:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ce085edbc00) 00010000:00010000:3.0:1788201269.047270:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201269.047287:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047293:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447203cd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047317:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047323:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047328:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047333:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201269.047336:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047341:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047349:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb200) 00010000:00010000:3.0:1788201269.047352:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201269.047355:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047360:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447203d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047375:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047380:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047391:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047396:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bac00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201269.047399:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047406:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047414:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb000) 00010000:00010000:3.0:1788201269.047417:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201269.047419:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.047425:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447203e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.048192:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.048224:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.048233:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.048240:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201269.048245:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.048253:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.048289:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb200) 00010000:00010000:0.0:1788201269.048292:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201269.048298:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.048305:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472041a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201269.088250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201269.088374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662283904 00000100:00100000:0.0:1788201269.088387:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662283904 00000100:00100000:0.0:1788201269.088463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:0.0:1788201269.088476:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:10501:x1875064662283904:12345-192.168.203.2@tcp:101:touch.500 00010000:00010000:0.0:1788201269.088513:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201269.088539:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030a00/0xf9b71aee44720421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201269.091388:0:6517:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2780us 00010000:00010000:2.0:1788201269.130554:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130578:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130590:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130605:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130613:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130619:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130769:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720436 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130785:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130793:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201269.130825:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201269.130829:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201269.130864:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130876:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130882:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130889:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130895:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201269.130899:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130907:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130919:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb000) 00010000:00010000:2.0:1788201269.130923:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201269.130927:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130944:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720428 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130956:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130963:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130969:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130974:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201269.130977:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130984:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.130992:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ce085edb700) 00010000:00010000:2.0:1788201269.130995:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201269.130998:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.131004:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472042f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.131045:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030a00/0xf9b71aee44720421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfd2 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.131061:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720436 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfd2 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.131074:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb900) 00010000:00010000:2.0:1788201269.131076:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201269.131079:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0000, rc 0) 00000100:00100000:2.0:1788201269.131163:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:10501:x1875064662283904:12345-192.168.203.2@tcp:101:touch.500 Request processed in 42689us (42927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201269.131172:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1788201269.137565:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201269.137786:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662284160 00000100:00100000:3.0:1788201269.137795:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662284160 00000100:00100000:3.0:1788201269.137888:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:3.0:1788201269.137898:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+7:10501:x1875064662284160:12345-192.168.203.2@tcp:101:touch.500 00010000:00010000:3.0:1788201269.137917:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201269.137936:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee4472043d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfd9 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138045:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138059:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138082:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138140:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138148:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138155:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201269.138539:0:10723:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788201269.138692:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720452 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138701:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138709:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138763:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138771:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138778:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138785:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201269.138795:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138803:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138816:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb900) 00010000:00010000:3.0:1788201269.138819:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201269.138823:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138830:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720444 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201269.138842:0:10723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003625543c reply state 0000000041f0c785 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138852:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138858:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cdf8193b500) 00010000:00010000:3.0:1788201269.138860:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201269.138863:0:10723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201269.138891:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee4472043d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfd9 expref: 10 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138904:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720452 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfd9 expref: 9 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.138911:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cdf8193b000) 00010000:00010000:3.0:1788201269.138913:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201269.138921:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba200, rc 0) 00000100:00100000:3.0:1788201269.138977:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+10:10501:x1875064662284160:12345-192.168.203.2@tcp:101:touch.500 Request processed in 1081us (1420us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788201269.138985:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1788201269.144378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201269.144464:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662284416 00000100:00100000:1.0:1788201269.144479:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662284416 00000100:00100000:1.0:1788201269.144548:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:1.0:1788201269.144559:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+10:10501:x1875064662284416:12345-192.168.203.2@tcp:36:touch.500 00010000:00010000:1.0:1788201269.144701:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201269.144727:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720452 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfd9 expref: 10 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.144780:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cdf8193b000) 00010000:00010000:1.0:1788201269.144793:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201269.144850:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.144959:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.144971:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201269.145071:0:8476:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001f343be reply state 0000000024135ef0 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.145082:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.145107:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ce089cc2c00) 00010000:00010000:1.0:1788201269.145109:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201269.145112:0:8476:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201269.149527:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+11:10501:x1875064662284416:12345-192.168.203.2@tcp:36:touch.500 Request processed in 4958us (5152us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788201269.149540:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:0.0:1788201269.176267:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201269.176438:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662284544 00000100:00100000:2.0:1788201269.176456:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662284544 00000100:00100000:2.0:1788201269.176554:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:2.0:1788201269.176566:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+11:10501:x1875064662284544:12345-192.168.203.2@tcp:101:touch.500 00010000:00010000:2.0:1788201269.176598:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201269.176623:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720467 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfe0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.176695:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720467 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfe0 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.176712:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720467 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfe0 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.176734:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ce089cc2c00) 00010000:00010000:2.0:1788201269.176782:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201269.176787:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0e00, rc 0) 00000100:00100000:2.0:1788201269.176863:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+12:10501:x1875064662284544:12345-192.168.203.2@tcp:101:touch.500 Request processed in 298us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201269.176891:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:3.0:1788201269.180787:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201269.181057:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662284672 00000100:00100000:1.0:1788201269.181070:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662284672 00000100:00100000:1.0:1788201269.181136:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1788201269.181146:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875064662284672:12345-192.168.203.2@tcp:8:touch.500 00010000:00080000:1.0:1788201269.181186:0:8485:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:1.0:1788201269.181231:0:8485:0:(genops.c:1406:class_connect()) connect: client da566c69-17bd-4938-bc1e-8b9ba2633293, cookie 0xf9b71aee4472046e 00002000:00100000:1.0:1788201269.181246:0:8485:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da566c69-17bd-4938-bc1e-8b9ba2633293/ffff9ce0b9736800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201269.181268:0:8485:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201269.181557:0:8485:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201269.181595:0:8485:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9733800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201269.181689:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2397:x1875064662284672:12345-192.168.203.2@tcp:8:touch.500 Request processed in 542us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201269.181697:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1788201269.187623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201269.188404:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662284800 00000100:00100000:2.0:1788201269.188420:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662284800 00000100:00100000:2.0:1788201269.188533:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1788201269.188545:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:0:x1875064662284800:12345-192.168.203.2@tcp:2:touch.500 00000100:00080000:0.0:1788201269.188866:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788201269.199817:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1788201269.199835:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000100:00100000:2.0:1788201269.200387:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:0:x1875064662284800:12345-192.168.203.2@tcp:2:touch.500 Request processed in 11835us (12769us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788201269.200402:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1788201269.202468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201269.202563:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662285056 00000100:00100000:3.0:1788201269.202575:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662285056 00000100:00100000:3.0:1788201269.202646:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1788201269.202659:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+12:10501:x1875064662285056:12345-192.168.203.2@tcp:35:touch.500 00000100:00100000:3.0:1788201269.203141:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+13:10501:x1875064662285056:12345-192.168.203.2@tcp:35:touch.500 Request processed in 482us (682us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788201269.203151:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1788201269.236447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201269.236620:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662285184 00000100:00100000:1.0:1788201269.236633:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662285184 00000100:00100000:1.0:1788201269.236728:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1788201269.236779:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+13:10502:x1875064662285184:12345-192.168.203.2@tcp:101:rm.0 00010000:00010000:1.0:1788201269.236809:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201269.236836:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfe7 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.236921:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472047c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.236939:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472047c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.236952:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472047c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201269.237025:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201269.237030:0:10723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201269.237073:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472047c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.237104:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfe7 expref: 15 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.237125:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472047c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfe7 expref: 14 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.237135:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb900) 00010000:00010000:1.0:1788201269.237138:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201269.237143:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201269.237446:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+14:10502:x1875064662285184:12345-192.168.203.2@tcp:101:rm.0 Request processed in 707us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201269.237464:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1788201269.240969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201269.241252:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662285440 00000100:00100000:3.0:1788201269.241265:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662285440 00000100:00100000:3.0:1788201269.241343:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:3.0:1788201269.241354:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+14:10502:x1875064662285440:12345-192.168.203.2@tcp:101:rm.0 00010000:00010000:3.0:1788201269.241381:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201269.241406:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720483 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbfee expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201269.241534:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788201269.241665:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720483 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfee expref: 16 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.241683:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb000) 00010000:00010000:3.0:1788201269.241686:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201269.241709:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720483 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfee expref: 16 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.241725:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bac00, rc 0) 00000100:00100000:3.0:1788201269.242020:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+15:10502:x1875064662285440:12345-192.168.203.2@tcp:101:rm.0 Request processed in 666us (1072us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788201269.242027:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:2.0:1788201269.247639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201269.247767:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662285568 00000100:00100000:3.0:1788201269.247782:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662285568 00000100:00100000:3.0:1788201269.247846:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1788201269.247858:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+15:10502:x1875064662285568:12345-192.168.203.2@tcp:37:rm.0 00000100:00100000:3.0:1788201269.252605:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+15:10502:x1875064662285568:12345-192.168.203.2@tcp:37:rm.0 Request processed in 4732us (4964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201269.252621:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:1.0:1788201269.263287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201269.263451:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662285824 00000100:00100000:0.0:1788201269.263465:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662285824 00000100:00100000:0.0:1788201269.263541:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:0.0:1788201269.263553:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf42050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+15:10502:x1875064662285824:12345-192.168.203.2@tcp:35:rm.0 00000100:00100000:0.0:1788201269.263906:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf42050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+16:10502:x1875064662285824:12345-192.168.203.2@tcp:35:rm.0 Request processed in 354us (632us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788201269.263916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1788201269.266956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201269.267068:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662286080 00000100:00100000:3.0:1788201269.267091:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662286080 00000100:00100000:3.0:1788201269.267167:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:3.0:1788201269.267179:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+16:10502:x1875064662286080:12345-192.168.203.2@tcp:101:rm.0 00010000:00010000:3.0:1788201269.267230:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201269.267258:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720491 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbff5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.267397:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720498 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.267414:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720498 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.267452:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720498 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201269.267467:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788201269.267645:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbff5 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.267669:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720498 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbff5 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.267678:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb900) 00010000:00010000:3.0:1788201269.267681:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201269.267686:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201269.267825:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+18:10502:x1875064662286080:12345-192.168.203.2@tcp:101:rm.0 Request processed in 648us (892us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788201269.267835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:1.0:1788201269.273129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201269.273300:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662286208 00000100:00100000:3.0:1788201269.273315:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662286208 00000100:00100000:3.0:1788201269.273394:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:3.0:1788201269.273406:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+18:10502:x1875064662286208:12345-192.168.203.2@tcp:41:rm.0 00000004:00000024:3.0:1788201269.273480:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788201269.273568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+18:10502:x1875064662286208:12345-192.168.203.2@tcp:41:rm.0 Request processed in 165us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201269.273576:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:0.0:1788201269.276898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201269.278223:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662286336 00000100:00100000:2.0:1788201269.278241:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662286336 00000100:00100000:2.0:1788201269.278329:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:2.0:1788201269.278341:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+18:10502:x1875064662286336:12345-192.168.203.2@tcp:101:rm.0 00010000:00010000:2.0:1788201269.278369:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201269.278395:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447204a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bbffc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278478:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278495:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278508:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278521:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278548:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278556:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278659:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447204bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278669:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447204bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278677:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447204bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201269.278723:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788201269.278728:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201269.278799:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447204bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278814:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447204bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278824:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278831:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278839:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278857:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201269.278862:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278871:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278886:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb900) 00010000:00010000:2.0:1788201269.278890:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201269.278895:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278902:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447204ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278918:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278924:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278931:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278936:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201269.278939:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278956:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278975:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cdf8193b500) 00010000:00010000:2.0:1788201269.278978:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201269.278982:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.278988:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447204b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.279030:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee447204a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbffc expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.279045:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447204bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbffc expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.279053:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ce089cc2c00) 00010000:00010000:2.0:1788201269.279056:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201269.279059:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1c00, rc 0) 00000100:00100000:2.0:1788201269.279145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+19:10502:x1875064662286336:12345-192.168.203.2@tcp:101:rm.0 Request processed in 805us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201269.279155:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:2.0:1788201269.284412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201269.284493:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662286592 00000100:00100000:1.0:1788201269.284506:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662286592 00000100:00100000:1.0:1788201269.284582:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:1.0:1788201269.284595:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+19:10502:x1875064662286592:12345-192.168.203.2@tcp:36:rm.0 00010000:00010000:1.0:1788201269.284670:0:10723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201269.284704:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447204bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbffc expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.284728:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720467 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfe0 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.284777:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ce089cc2c00) 00010000:00010000:1.0:1788201269.284790:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472047c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfe7 expref: 17 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.284800:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb900) 00010000:00010000:1.0:1788201269.284803:0:10723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201269.284829:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.284845:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.284856:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.284885:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.284894:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.284902:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.285091:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.285101:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.285107:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201269.285631:0:10723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788201269.285644:0:10723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349582904751ns, next at 350582902086ns, rc = 0 00010000:00010000:1.0:1788201269.285698:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.285710:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.285718:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.285725:0:10723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.285768:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.285774:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286297:0:10723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201269.286329:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286338:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286345:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286351:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201269.286357:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286365:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286378:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ce089cc2c00) 00010000:00010000:1.0:1788201269.286382:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201269.286386:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286393:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204d0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286414:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286429:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286434:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286439:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201269.286442:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286448:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286456:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb900) 00010000:00010000:1.0:1788201269.286458:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201269.286460:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286466:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201269.286478:0:10723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c080d87c reply state 000000003019c587 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286490:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.286496:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cdf8193b500) 00010000:00010000:1.0:1788201269.286498:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201269.286501:0:10723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201269.286715:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+18:10502:x1875064662286592:12345-192.168.203.2@tcp:36:rm.0 Request processed in 2116us (2312us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788201269.286732:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00010000:00010000:3.0:1788201269.287567:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201269.287580:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.287601:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201269.287606:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.287614:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.287628:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ce089cc2c00) 00010000:00010000:3.0:1788201269.287631:0:7466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201269.287635:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.287641:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447204d7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201269.287658:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201269.287660:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201269.287662:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201269.291576:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201269.291723:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662286848 00000100:00100000:0.0:1788201269.291886:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662286848 00000100:00100000:0.0:1788201269.291985:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1788201269.291998:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+18:10502:x1875064662286848:12345-192.168.203.2@tcp:35:rm.0 00000100:00100000:0.0:1788201269.292491:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+19:10502:x1875064662286848:12345-192.168.203.2@tcp:35:rm.0 Request processed in 495us (928us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788201269.292499:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1788201269.302267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201269.302315:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662287104 00000100:00100000:1.0:1788201269.302328:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662287104 00000100:00100000:1.0:1788201269.302455:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:1.0:1788201269.302468:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+19:10502:x1875064662287104:12345-192.168.203.2@tcp:36:rm.0 00010000:00010000:1.0:1788201269.302538:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201269.302654:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720498 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbff5 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302677:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720436 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfd2 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302690:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce085edb900) 00010000:00010000:1.0:1788201269.302708:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee447203f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfc4 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302717:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce085edb000) 00010000:00010000:1.0:1788201269.302722:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201269.302804:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302821:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302832:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302867:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302875:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302882:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302977:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302986:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.302993:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201269.303527:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788201269.303635:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303646:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303653:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303660:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201269.303665:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303684:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303695:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ce089cc2f00) 00010000:00010000:1.0:1788201269.303698:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201269.303702:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303709:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447204ec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303728:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303734:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303822:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303827:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201269.303830:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303836:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303845:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce089cc2d00) 00010000:00010000:1.0:1788201269.303847:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201269.303850:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303866:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447204de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201269.303881:0:8476:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a702de8 reply state 0000000013d6c664 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303894:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.303901:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ce089cc2100) 00010000:00010000:1.0:1788201269.303903:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201269.303906:0:8476:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201269.304004:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+18:10502:x1875064662287104:12345-192.168.203.2@tcp:36:rm.0 Request processed in 1535us (1747us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788201269.304013:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:2.0:1788201269.366148:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681244288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201269.366253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201269.366788:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681244288 00000100:00100000:3.0:1788201269.366799:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681244288 00000100:00100000:3.0:1788201269.366882:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201269.366894:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681244288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201269.366922:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201269.366980:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681244288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201269.366988:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1788201269.367090:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4e8a80 x1875064681244288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201269.367113:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681244288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201269.367160:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201269.367169:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681244416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201269.367199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201269.367338:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201269.367399:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681244416 00000100:00100000:3.0:1788201269.367403:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681244416 00000100:00100000:3.0:1788201269.367447:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788201269.367461:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681244416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201269.367474:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201269.367513:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681244416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201269.367520:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788201269.367679:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201269.371204:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834ce680 x1875064681244416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201269.371254:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681244416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201269.434780:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201270.467966:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201271.478011:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201271.926675:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201271.926700:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681244544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201271.926802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.926962:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681244800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.927024:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681245312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.927062:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681245824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.927107:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201271.927113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681244928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.927157:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681245440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.927209:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681245952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.927256:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681244800 00000100:00100000:1.0:1788201271.927263:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681244800 00000100:00100000:1.0:1788201271.927299:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681245312 00000100:00100000:1.0:1788201271.927302:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681245312 00000100:00100000:1.0:1788201271.927325:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681245824 00000100:00100000:1.0:1788201271.927328:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681245824 00000100:00100000:1.0:1788201271.927342:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681245440 00000100:00100000:1.0:1788201271.927344:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681245440 00000100:00100000:1.0:1788201271.927361:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681245952 00000100:00100000:1.0:1788201271.927367:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681245952 00000100:00100000:1.0:1788201271.927392:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788201271.927405:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681244800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927463:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681244800:12345-0@lo:400:kworker.0 Request processed in 61us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.927471:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788201271.927491:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788201271.927501:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681245312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927550:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681245312:12345-0@lo:400:kworker.0 Request processed in 53us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.927561:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788201271.927587:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788201271.927772:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681245824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927802:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681245824:12345-0@lo:400:kworker.0 Request processed in 34us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.927808:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788201271.927824:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788201271.927830:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681245440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927855:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681245440:12345-0@lo:400:kworker.0 Request processed in 25us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.927861:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788201271.927872:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788201271.927878:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681245952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.927900:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681245952:12345-0@lo:400:kworker.0 Request processed in 23us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.927905:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788201271.927923:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681244928 00000100:00100000:1.0:1788201271.927927:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681244928 00000100:00100000:1.0:1788201271.927966:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788201271.927977:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681244928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928220:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681244928:12345-0@lo:400:kworker.0 Request processed in 246us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.928227:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788201271.928251:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201271.928254:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201271.928266:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681244672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.928336:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681245184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.928391:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681245696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.928435:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788201271.928441:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681245056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.928479:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681245568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.928512:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681246080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928534:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201271.928561:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681245696 00000100:00100000:1.0:1788201271.928565:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681245696 00000100:00100000:1.0:1788201271.928593:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681245568 00000100:00100000:1.0:1788201271.928596:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681245568 00000100:00100000:1.0:1788201271.928670:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681246080 00000100:00100000:1.0:1788201271.928673:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681246080 00000100:00100000:1.0:1788201271.928686:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201271.928692:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681245696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928728:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681245696:12345-0@lo:400:kworker.0 Request processed in 36us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.928734:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201271.928766:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201271.928772:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681245568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928797:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681245568:12345-0@lo:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.928802:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201271.928824:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201271.928830:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681246080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.928873:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681246080:12345-0@lo:400:kworker.0 Request processed in 43us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.928878:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201271.932165:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681244544 00000100:00100000:3.0:1788201271.932181:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681244544 00000100:00100000:2.0:1788201271.932303:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681245056 00000100:00100000:2.0:1788201271.932309:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681245056 00000100:00100000:2.0:1788201271.932369:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788201271.932379:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681245056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201271.932465:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681245056:12345-0@lo:400:kworker.0 Request processed in 88us (4000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.932473:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788201271.932496:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681245184 00000100:00100000:2.0:1788201271.932499:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681245184 00000100:00100000:2.0:1788201271.932524:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201271.932531:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681245184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201271.932564:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681245184:12345-0@lo:400:kworker.0 Request processed in 34us (4189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.932570:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201271.932833:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788201271.932842:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681244544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201271.932867:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201271.932905:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681244544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (6103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201271.932911:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788201271.933524:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201271.933530:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201271.933566:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681244928:0@lo:400:kworker.0 00010000:00080000:1.0:1788201271.933582:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823ac000 x1875064681245440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.933593:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681245440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201271.934753:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681244672 00000100:00100000:0.0:1788201271.934763:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681244672 00000100:00100000:0.0:1788201271.934819:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788201271.934828:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681244672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201271.934930:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681244672:12345-0@lo:400:kworker.0 Request processed in 92us (6620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201271.934937:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00080000:1.0:1788201271.935203:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823aed80 x1875064681245952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.935216:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681245952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.935235:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681244800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.935246:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681245312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.935257:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681245824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.935307:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681245056:0@lo:400:kworker.0 00010000:00080000:1.0:1788201271.935320:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823ae680 x1875064681245568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.935329:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681245568:0@lo:400:kworker.0 00010000:00080000:1.0:1788201271.935340:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8362dc00 x1875064681246080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.935364:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681246080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.935376:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681244672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201271.935388:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681245184:0@lo:400:kworker.0 00010000:00080000:1.0:1788201271.935399:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823ad880 x1875064681245696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.935406:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681245696:0@lo:400:kworker.0 00010000:00080000:1.0:1788201271.935419:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0700 x1875064681244544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.935436:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681244544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201272.450095:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201272.450121:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681246208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201272.450210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201272.450326:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681246208 00000100:00100000:3.0:1788201272.450334:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681246208 00000100:00100000:3.0:1788201272.450396:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788201272.450405:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681246208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201272.450430:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201272.450478:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681246208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.450485:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1788201272.450524:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82396a00 x1875064681246208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201272.450541:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681246208:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201272.501866:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201272.519450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201272.519499:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201272.519542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201272.519561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201272.519579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201272.519601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201272.519630:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662287488 00000100:00100000:3.0:1788201272.519639:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662287488 00000100:00100000:3.0:1788201272.519694:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662287744 00000100:00100000:3.0:1788201272.519697:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662287744 00000100:00100000:3.0:1788201272.519713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662287360 00000100:00100000:3.0:1788201272.519715:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662287360 00000100:00100000:3.0:1788201272.519729:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662287872 00000100:00100000:3.0:1788201272.519731:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662287872 00000100:00100000:3.0:1788201272.519776:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 211 00000100:00100000:3.0:1788201272.519787:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662287488:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201272.519861:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662287488:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 76us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.519868:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 211 00000100:00100000:3.0:1788201272.519885:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 212 00000100:00100000:3.0:1788201272.519892:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662287744:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201272.519916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662287744:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.520078:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662287232 00000100:00100000:1.0:1788201272.520083:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662287232 00000100:00100000:1.0:1788201272.520116:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 335 00000100:00100000:1.0:1788201272.520124:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662287232:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201272.520161:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662287232:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 39us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.520168:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 335 00000100:00080000:1.0:1788201272.520208:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201272.520212:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201272.520223:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 213 00000100:00100000:1.0:1788201272.520230:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+18:2399:x1875064662287360:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201272.520271:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+18:2399:x1875064662287360:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 41us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.520280:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 213 00000100:00100000:1.0:1788201272.520297:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 214 00000100:00100000:1.0:1788201272.520306:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662287872:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201272.520339:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662287872:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 34us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.520345:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 214 00000100:00100000:3.0:1788201272.521121:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 212 00000100:00100000:3.0:1788201272.521155:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662287616 00000100:00100000:3.0:1788201272.521159:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662287616 00000100:00100000:3.0:1788201272.521213:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:3.0:1788201272.521222:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662287616:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201272.521313:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662287616:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 92us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.521331:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00080000:1.0:1788201272.522709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201273.526781:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201273.757153:0:13680:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788201273.975014:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201273.975037:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681246336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201273.975103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201273.975537:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681246336 00000100:00100000:0.0:1788201273.975544:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681246336 00000100:00100000:0.0:1788201273.975592:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788201273.975601:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681246336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201273.975645:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788201273.975690:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681246336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201273.975697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788201273.975755:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681246336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201273.993057:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681246464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201273.993128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201273.993207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681246464 00000100:00100000:3.0:1788201273.993214:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681246464 00000100:00100000:3.0:1788201273.993259:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201273.993268:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681246464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201273.993301:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201273.993341:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681246464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201273.993348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201273.993387:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681246464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201274.489560:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681246592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201274.489649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201274.489764:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681246592 00000100:00100000:1.0:1788201274.489775:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681246592 00000100:00100000:1.0:1788201274.489838:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788201274.489849:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681246592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201274.489885:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201274.490008:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681246592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 160us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201274.490016:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788201274.490040:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201274.490080:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82397b80 x1875064681246592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201274.490183:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681246592:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788201274.491100:0:8483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354788359992ns, next at 355788356873ns, rc = 0 00000100:00100000:1.0:1788201274.491179:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681246720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201274.491238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201274.491298:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681246720 00000100:00100000:3.0:1788201274.491305:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681246720 00000100:00080000:1.0:1788201274.491342:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201274.491350:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788201274.491359:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681246720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201274.491379:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201274.491422:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681246720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201274.491430:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788201274.491651:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4e8380 x1875064681246720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201274.491670:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681246720:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788201274.492652:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788201274.492668:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788201274.492861:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201274.492879:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681246848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201274.492933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201274.492959:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681246848 00000100:00100000:0.0:1788201274.492966:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681246848 00010000:00010000:2.0:1788201274.493114:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493132:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201274.493160:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201274.493184:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681246848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201274.493215:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788201274.493257:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a95c934, atime: 0x6a95c934, ctime: 0x6a95c934, blocks: 0x0 00010000:00010000:0.0:1788201274.493266:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201274.493283:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1788201274.493288:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201274.493296:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201274.493314:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201274.493323:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201274.493341:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201274.493359:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201274.493548:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681246848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 379us (614us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788201274.493555:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788201274.493588:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201274.493598:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201274.493605:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493607:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bae00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201274.493613:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201274.493613:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201274.493617:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493621:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201274.493625:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493640:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cdf8193b500) 00010000:00010000:1.0:1788201274.493642:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493644:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201274.493647:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201274.493650:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000707c4d6d/0xf9b71aee447204f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493653:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472044b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493668:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201274.493668:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201274.493675:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201274.493675:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201274.493677:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201274.493681:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493685:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201274.493688:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493693:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493708:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ce089cc2c00) 00000004:00080000:1.0:1788201274.493708:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf82396680/2, rc 0, transno 4294967301 00010000:00010000:2.0:1788201274.493711:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201274.493713:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681246848:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201274.493714:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493720:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255200/0xf9b71aee44720460 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493756:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493763:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493769:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493774:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201274.493776:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493782:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493790:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9cdf8193b500) 00010000:00010000:2.0:1788201274.493793:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201274.493796:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493802:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447204c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493828:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493834:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493839:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493843:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201274.493845:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493850:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493857:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ce089cc2100) 00010000:00010000:2.0:1788201274.493859:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201274.493861:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.493866:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447204e5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201274.550231:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201275.090571:0:13729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7cce0760 20000000:00000080:0.0:1788201275.090593:0:13729:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce0b6d2f800 uarg=0000000000000000 20000000:01000000:0.0:1788201275.090649:0:13729:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788201275.090658:0:13729:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788201275.090664:0:13729:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788201275.094115:0:13730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788201275.095068:0:13729:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788201275.119734:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788201275.119924:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788201275.119949:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788201275.120035:0:13729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788201275.120063:0:13729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120086:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720380 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120094:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472038e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120102:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472039c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120109:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447203aa expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120119:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120127:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120135:0:13729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120226:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120246:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 12 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201275.120267:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681246976:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201275.120654:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120664:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 12 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201275.120687:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247104:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201275.120724:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee447203aa expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120733:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee447203aa expref: 23 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201275.120790:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247232:0@lo:104: 00000100:00100000:1.0:1788201275.120847:0:13729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201275.120907:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472039c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.120917:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472039c expref: 23 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201275.120952:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247360:0@lo:104: 00010000:00010000:1.0:1788201275.121001:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472038e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.121010:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472038e expref: 23 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201275.121018:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247488:0@lo:104: 00010000:00010000:1.0:1788201275.121045:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44720380 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.121054:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44720380 expref: 23 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201275.121063:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247616:0@lo:104: 00000100:00100000:1.0:1788201275.121083:0:13729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf83733600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201275.121424:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201275.121455:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201275.121485:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201275.121494:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201275.121513:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681247232 00000100:00100000:2.0:1788201275.121531:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681247232 00000100:00100000:2.0:1788201275.121594:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681247360 00000100:00100000:2.0:1788201275.121597:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681247360 00000100:00100000:2.0:1788201275.121620:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681247488 00000100:00100000:2.0:1788201275.121623:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681247488 00000100:00100000:2.0:1788201275.121633:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681247616 00000100:00100000:2.0:1788201275.121635:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681247616 00000100:00100000:2.0:1788201275.121651:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201275.121660:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:13729:x1875064681247232:12345-0@lo:104: 00010000:00010000:2.0:1788201275.121675:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.121775:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201275.121781:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+6:13729:x1875064681247232:12345-0@lo:104: Request processed in 123us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201275.121788:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201275.121834:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201275.121841:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:13729:x1875064681247360:12345-0@lo:104: 00010000:00010000:2.0:1788201275.121849:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.121885:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201275.121891:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+5:13729:x1875064681247360:12345-0@lo:104: Request processed in 51us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201275.121896:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201275.121914:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201275.121921:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:13729:x1875064681247488:12345-0@lo:104: 00010000:00010000:2.0:1788201275.121928:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.121994:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788201275.121999:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+4:13729:x1875064681247488:12345-0@lo:104: Request processed in 80us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201275.122006:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201275.122023:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201275.122030:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:13729:x1875064681247616:12345-0@lo:104: 00010000:00010000:2.0:1788201275.122038:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122066:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788201275.122072:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+3:13729:x1875064681247616:12345-0@lo:104: Request processed in 43us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201275.122078:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788201275.122100:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201275.122107:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122115:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201275.122120:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122130:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201275.122138:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201275.122145:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201275.122212:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122219:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201275.122245:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122252:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75400/0xf9b71aee447203aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447203b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122270:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201275.122274:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122280:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74a00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201275.122283:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122291:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201275.122297:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201275.122302:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201275.122315:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122321:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201275.122340:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122358:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee4472039c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447203a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122370:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201275.122373:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122379:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201275.122383:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122401:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201275.122408:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201275.122413:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201275.122428:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122434:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201275.122441:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122448:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee4472038e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720395 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122457:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201275.122467:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122473:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75600 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201275.122477:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122484:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201275.122489:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201275.122494:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201275.122508:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122514:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201275.122521:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122527:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44720380 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44720387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.122541:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201275.122543:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201275.122545:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201275.122554:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201275.122560:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201275.122584:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681247744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201275.122624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201275.122669:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201275.122676:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681248128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201275.122701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201275.122731:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681247872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201275.122787:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201275.122809:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201275.122814:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681248000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201275.122847:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201275.122879:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681247744 00000100:00100000:2.0:1788201275.122884:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681247744 00010000:00010000:2.0:1788201275.122906:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447203aa expref: 24 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201275.122931:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681248128 00000100:00100000:2.0:1788201275.122934:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681248128 00010000:00010000:2.0:1788201275.122946:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720380 expref: 25 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201275.122956:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681247872 00000100:00100000:2.0:1788201275.122958:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681247872 00010000:00010000:2.0:1788201275.122967:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472039c expref: 26 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201275.122976:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681248000 00000100:00100000:2.0:1788201275.122978:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681248000 00010000:00010000:2.0:1788201275.122988:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472038e expref: 27 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201275.122999:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201275.123006:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+27:3647:x1875064681247744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201275.123029:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201275.123035:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447203aa expref: 27 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.123045:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee447203aa expref: 27 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.123063:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201275.123104:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+27:3647:x1875064681247744:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201275.123111:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201275.123126:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201275.123132:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+26:3647:x1875064681248128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201275.123140:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201275.123144:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44720380 expref: 26 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.123152:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44720380 expref: 26 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.123161:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201275.123194:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+26:3647:x1875064681248128:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201275.123201:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201275.123213:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201275.123219:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+25:3644:x1875064681247872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201275.123228:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201275.123232:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472039c expref: 25 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.123246:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472039c expref: 25 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.123256:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201275.123283:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+25:3644:x1875064681247872:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201275.123290:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201275.123302:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201275.123308:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681248000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201275.123315:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201275.123319:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472038e expref: 24 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.123326:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472038e expref: 24 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201275.123335:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201275.123356:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681248000:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201275.123362:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201275.123414:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681248000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201275.123423:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681247872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201275.123449:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681248128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201275.123456:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681247744:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201275.123724:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce080031000/0xf9b71aee447203b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee447203aa expref: 23 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201275.123773:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247232:0@lo:104: 00010000:00010000:3.0:1788201275.123808:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447203a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472039c expref: 22 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201275.123818:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247360:0@lo:104: 00010000:00010000:3.0:1788201275.123829:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75200/0xf9b71aee44720395 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472038e expref: 21 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201275.123838:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247488:0@lo:104: 00010000:00010000:3.0:1788201275.123847:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0800/0xf9b71aee44720387 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44720380 expref: 20 pid: 6510 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201275.123855:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247616:0@lo:104: 00000100:00100000:1.0:1788201275.135541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201275.135580:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201275.135729:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662288000 00000100:00100000:0.0:1788201275.135778:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662288000 00010000:00010000:0.0:1788201275.135831:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 13 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201275.135868:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662288128 00000100:00100000:0.0:1788201275.135871:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662288128 00010000:00010000:0.0:1788201275.135886:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 14 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201275.135906:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:0.0:1788201275.135917:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+14:2399:x1875064662288000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201275.135937:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201275.135962:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 14 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.135978:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 14 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136009:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201275.136081:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+14:2399:x1875064662288000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 164us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201275.136090:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:0.0:1788201275.136114:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:0.0:1788201275.136121:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662288128:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201275.136129:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201275.136134:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 13 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136144:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 13 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136159:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136179:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136199:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136208:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136227:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136234:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136242:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201275.136248:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136258:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136271:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201275.136285:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201275.136308:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662288128:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 187us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201275.136315:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00010000:00010000:3.0:1788201275.136894:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee447203bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfb6 expref: 12 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201275.137226:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681246976:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201275.137246:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1400/0xf9b71aee447203b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbfaf expref: 11 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201275.137258:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875064681247104:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201275.137305:0:13729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201275.137317:0:13729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201275.137324:0:13729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201275.137348:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255600/0xf9b71aee447204fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.578016:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201275.944015:0:13778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6e281950 20000000:00000080:1.0:1788201275.944043:0:13778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cdf836f3400 uarg=0000000000000000 20000000:01000000:1.0:1788201275.944110:0:13778:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788201275.944118:0:13778:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788201275.944125:0:13778:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788201275.945134:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788201275.945496:0:13778:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788201275.945684:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788201275.945724:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788201275.946041:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788201275.946059:0:13778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788201275.946089:0:13778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946109:0:13778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946121:0:13778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946129:0:13778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946136:0:13778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946143:0:13778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946150:0:13778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201275.946155:0:13778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946175:0:13778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946190:0:13778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946198:0:13778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201275.946215:0:13778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44720501 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201276.545471:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201276.545570:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662288256 00000100:00100000:0.0:1788201276.545580:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662288256 00000100:00100000:0.0:1788201276.545636:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 336 00000100:00100000:0.0:1788201276.545647:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:6171:x1875064662288256:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201276.545663:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201276.545684:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce080031800/0xf9b71aee44720508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc003 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.545712:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce080031800/0xf9b71aee44720508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc003 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.545735:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce080031800/0xf9b71aee44720508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc003 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.545793:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce080031800, rc 0) 00000100:00100000:0.0:1788201276.545853:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662288256:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 208us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201276.545859:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 336 00000100:00100000:1.0:1788201276.550262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201276.551140:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662288384 00000100:00100000:0.0:1788201276.551151:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662288384 00000100:00100000:0.0:1788201276.551230:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 337 00000100:00100000:0.0:1788201276.551240:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662288384:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201276.551390:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662288384:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 152us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201276.551398:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 337 00000100:00100000:3.0:1788201276.561538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201276.562933:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662288512 00000100:00100000:1.0:1788201276.562947:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662288512 00000100:00100000:1.0:1788201276.563017:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 338 00000100:00100000:1.0:1788201276.563027:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662288512:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201276.563356:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662288512:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 329us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201276.563365:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 338 00000100:00100000:1.0:1788201276.569645:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201276.570212:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662288640 00000100:00100000:3.0:1788201276.570222:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662288640 00000100:00100000:3.0:1788201276.570387:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 339 00000100:00100000:3.0:1788201276.570398:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:10787:x1875064662288640:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201276.570567:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:10787:x1875064662288640:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 170us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.570576:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 339 00000100:00100000:0.0:1788201276.575470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201276.577501:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662288768 00000100:00100000:1.0:1788201276.577515:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662288768 00000100:00100000:1.0:1788201276.577590:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 340 00000100:00100000:1.0:1788201276.577600:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:10787:x1875064662288768:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201276.577791:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:10787:x1875064662288768:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 192us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201276.577798:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 340 00000100:00100000:1.0:1788201276.585872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201276.588244:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662288896 00000100:00100000:3.0:1788201276.588260:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662288896 00000100:00100000:3.0:1788201276.588392:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 341 00000100:00100000:3.0:1788201276.588403:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:6171:x1875064662288896:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201276.588419:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201276.588436:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bb400/0xf9b71aee4472050f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc00a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.588465:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bb400/0xf9b71aee4472050f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc00a expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.588477:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bb400/0xf9b71aee4472050f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc00a expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.588485:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb400, rc 0) 00000100:00100000:3.0:1788201276.588576:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662288896:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 175us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.588598:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 341 00000100:00100000:0.0:1788201276.592230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201276.592324:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662289024 00000100:00100000:1.0:1788201276.592333:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662289024 00000100:00100000:1.0:1788201276.592418:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 342 00000100:00100000:1.0:1788201276.592429:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662289024:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201276.592601:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662289024:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 173us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201276.592609:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 342 00000100:00100000:3.0:1788201276.595201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1788201276.597847:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201276.603927:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662289152 00000100:00100000:0.0:1788201276.603943:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662289152 00000100:00100000:1.0:1788201276.604022:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 343 00000100:00100000:1.0:1788201276.604035:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662289152:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201276.604208:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:6171:x1875064662289152:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 176us (9016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201276.604216:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 343 00000100:00100000:3.0:1788201276.608732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201276.608942:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662289280 00000100:00100000:0.0:1788201276.608951:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662289280 00000100:00100000:0.0:1788201276.609007:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 344 00000100:00100000:0.0:1788201276.609015:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:10790:x1875064662289280:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201276.609170:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:10790:x1875064662289280:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 143us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201276.609178:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 344 00000100:00100000:2.0:1788201276.612141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201276.612544:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662289408 00000100:00100000:3.0:1788201276.612554:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662289408 00000100:00100000:3.0:1788201276.612616:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 345 00000100:00100000:3.0:1788201276.612626:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:10790:x1875064662289408:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201276.612800:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:10790:x1875064662289408:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 175us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.612808:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 345 00000100:00100000:0.0:1788201277.046457:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201277.046480:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681248256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201277.046571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.047355:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681248512:0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.047398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.047432:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681249024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.047455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.047480:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681249536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.047502:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.047524:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201277.047530:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681248384:0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.047593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.047614:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681248896:0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.047636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.047651:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681249408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.047670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.047699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681248512 00000100:00100000:0.0:1788201277.047705:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681248512 00000100:00100000:0.0:1788201277.047769:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681249024 00000100:00100000:0.0:1788201277.047772:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681249024 00000100:00100000:0.0:1788201277.047818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681249536 00000100:00100000:0.0:1788201277.047821:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681249536 00000100:00100000:0.0:1788201277.047850:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788201277.047858:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681248512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048285:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681248768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201277.048340:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681249280:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201277.048380:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681249792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201277.048415:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201277.048421:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681248640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201277.048455:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681249152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201277.048482:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681249664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201277.048519:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681249408 00000100:00100000:2.0:1788201277.048524:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681249408 00000100:00100000:2.0:1788201277.048570:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681249280 00000100:00100000:2.0:1788201277.048574:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681249280 00000100:00100000:2.0:1788201277.048586:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681249792 00000100:00100000:2.0:1788201277.048588:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681249792 00000100:00100000:2.0:1788201277.048602:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201277.048609:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681249408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048651:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681249408:12345-0@lo:400:kworker.0 Request processed in 42us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.048657:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201277.048671:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201277.048686:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681249280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048717:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681249280:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.048722:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201277.048733:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201277.048778:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681249792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.048804:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681249792:12345-0@lo:400:kworker.0 Request processed in 66us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.048809:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201277.048837:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681248896 00000100:00100000:2.0:1788201277.048842:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681248896 00000100:00100000:2.0:1788201277.048865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681248640 00000100:00100000:2.0:1788201277.048868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681248640 00000100:00100000:2.0:1788201277.048880:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788201277.048886:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681248896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049192:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681248512:12345-0@lo:400:kworker.0 Request processed in 1332us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.049210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788201277.049229:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681248768 00000100:00100000:0.0:1788201277.049232:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681248768 00000100:00100000:0.0:1788201277.049246:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681249152 00000100:00100000:0.0:1788201277.049249:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681249152 00000100:00100000:0.0:1788201277.049260:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681249664 00000100:00100000:0.0:1788201277.049262:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681249664 00000100:00100000:0.0:1788201277.049276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788201277.049282:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681249024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049317:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681249024:12345-0@lo:400:kworker.0 Request processed in 35us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.049323:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788201277.049335:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788201277.049342:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681249536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049367:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681249536:12345-0@lo:400:kworker.0 Request processed in 27us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.049372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788201277.049382:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788201277.049387:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681248768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049412:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681248768:12345-0@lo:400:kworker.0 Request processed in 25us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.049417:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788201277.049427:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788201277.049433:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681249152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049457:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681249152:12345-0@lo:400:kworker.0 Request processed in 25us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.049474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788201277.049486:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788201277.049491:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681249664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049521:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681249664:12345-0@lo:400:kworker.0 Request processed in 30us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.049526:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788201277.049567:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788201277.049575:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681248640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049606:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681248640:12345-0@lo:400:kworker.0 Request processed in 33us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.049612:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788201277.049680:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681248640:0@lo:400:kworker.0 00010000:00080000:0.0:1788201277.049695:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82395500 x1875064681249152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.049705:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681249152:0@lo:400:kworker.0 00010000:00080000:0.0:1788201277.049715:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82605c00 x1875064681249664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.049724:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681249664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049736:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681248768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201277.049770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681249280:0@lo:400:kworker.0 00010000:00080000:0.0:1788201277.049781:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82604e00 x1875064681249792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.049801:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681249792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.050147:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681248896:12345-0@lo:400:kworker.0 Request processed in 1061us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.050164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788201277.050219:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681248896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.050233:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681249408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.050242:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681248512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.050253:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681249024:0@lo:400:kworker.0 00000100:00100000:2.0:1788201277.050263:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681249536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201277.050362:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681248256 00000100:00100000:1.0:1788201277.050368:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681248256 00000100:00100000:1.0:1788201277.050419:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201277.050426:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681248256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201277.050462:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201277.050505:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681248256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201277.050511:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788201277.050527:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201277.050533:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201277.050547:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201277.050551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788201277.050574:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823af100 x1875064681248256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201277.050589:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681248256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201277.050611:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681248384 00000100:00100000:1.0:1788201277.050614:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681248384 00000100:00100000:1.0:1788201277.050649:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788201277.050654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:3645:x1875064681248384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201277.050689:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:3645:x1875064681248384:12345-0@lo:400:kworker.0 Request processed in 35us (3095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201277.050695:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788201277.050729:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681248384:0@lo:400:kworker.0 10000000:01000000:0.0:1788201277.109981:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201277.109989:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cdf81977800 from 7 10000000:01000000:0.0:1788201277.109993:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201277.110043:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.110056:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.110066:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201277.110092:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681249920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.110179:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.110263:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201277.110458:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681249920 00000100:00100000:3.0:1788201277.110467:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681249920 00000100:00100000:3.0:1788201277.110526:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788201277.110536:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:6513:x1875064681249920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201277.110560:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201277.110575:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee4472051d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720516 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201277.110600:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee4472051d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720516 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201277.110611:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee4472051d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720516 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201277.110620:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbe00, rc 0) 00000100:00100000:3.0:1788201277.110667:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681249920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201277.110688:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788201277.111671:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681249920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201277.111693:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.111704:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201277.111814:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.111859:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.114104:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201277.120118:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681250048 00000100:00100000:1.0:1788201277.120134:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681250048 00000100:00100000:1.0:1788201277.120294:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788201277.120305:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681250048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201277.120495:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681250048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (8636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201277.120504:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788201277.120614:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.120686:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.120771:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.131349:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201277.140473:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681250176 00000100:00100000:3.0:1788201277.140489:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681250176 00000100:00100000:3.0:1788201277.140575:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788201277.140586:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681250176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201277.140796:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681250176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (20055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201277.140804:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788201277.140962:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.142504:0:13791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13791:1875064681250304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.142591:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.142637:0:13791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201277.142702:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681250304 00000100:00100000:3.0:1788201277.142708:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681250304 00000100:00100000:3.0:1788201277.142783:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788201277.142793:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:13791:x1875064681250304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201277.142934:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:13791:x1875064681250304:12345-0@lo:502:llog_process_th.0 Request processed in 143us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201277.142943:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788201277.143439:0:13791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13791:1875064681250304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201277.143481:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201277.143493:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.143496:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201277.143502:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cdf81977800 00000020:00000080:0.0:1788201277.143504:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201277.143581:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201277.143585:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.143587:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201277.143589:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201277.143592:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.143593:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788201277.143597:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cdf81977800 00000020:00000080:0.0:1788201277.143599:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201277.143637:0:13791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13791:1875064681250432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.143679:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.143705:0:13791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.144861:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681250432 00000100:00100000:0.0:1788201277.144869:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681250432 00000100:00100000:0.0:1788201277.144913:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788201277.144932:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:13791:x1875064681250432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.145366:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:13791:x1875064681250432:12345-0@lo:502:llog_process_th.0 Request processed in 434us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.145375:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788201277.145434:0:13791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13791:1875064681250432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201277.145473:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201277.145480:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.145482:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788201277.145486:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788201277.145765:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788201277.145784:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201277.145792:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.145804:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201277.145813:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201277.145816:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b95bd800 from 7 10000000:01000000:0.0:1788201277.145818:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201277.146033:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.146042:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.146052:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201277.146074:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.146120:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.146162:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.146179:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681250560 00000100:00100000:0.0:1788201277.146184:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681250560 00000100:00100000:0.0:1788201277.146207:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788201277.146216:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:6513:x1875064681250560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201277.146226:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201277.146239:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce080030800/0xf9b71aee4472052b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720524 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.146266:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce080030800/0xf9b71aee4472052b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720524 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.146277:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce080030800/0xf9b71aee4472052b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720524 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.146286:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce080030800, rc 0) 00000100:00100000:0.0:1788201277.146314:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681250560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.146320:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788201277.146354:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201277.146367:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.146375:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201277.146436:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.146623:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.146638:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.146651:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681250688 00000100:00100000:0.0:1788201277.146654:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681250688 00000100:00100000:0.0:1788201277.146670:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788201277.146675:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681250688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.146782:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681250688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.146788:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788201277.146810:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.147064:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.147098:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.147112:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.147124:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681250816 00000100:00100000:0.0:1788201277.147128:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681250816 00000100:00100000:0.0:1788201277.147144:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788201277.147149:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681250816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.147232:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681250816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.147239:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788201277.147275:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681250816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.147650:0:13792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13792:1875064681250944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.147683:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.147702:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681250944 00000100:00100000:0.0:1788201277.147712:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681250944 00000100:00100000:0.0:1788201277.147731:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788201277.147752:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:13792:x1875064681250944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.147820:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:13792:x1875064681250944:12345-0@lo:502:llog_process_th.0 Request processed in 83us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.147839:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788201277.147866:0:13792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.147878:0:13792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13792:1875064681250944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201277.147909:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201277.147919:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.147921:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201277.147927:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0b95bd800 00000020:00000080:0.0:1788201277.147930:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201277.147985:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201277.147989:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.147991:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201277.147993:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201277.147995:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.147997:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788201277.148000:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0b95bd800 00000020:00000080:0.0:1788201277.148003:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201277.148031:0:13792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13792:1875064681251072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.148061:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.148080:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681251072 00000100:00100000:0.0:1788201277.148083:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681251072 00000100:00100000:0.0:1788201277.148100:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788201277.148106:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:13792:x1875064681251072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.148171:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:13792:x1875064681251072:12345-0@lo:502:llog_process_th.0 Request processed in 64us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.148183:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788201277.148207:0:13792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.148217:0:13792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13792:1875064681251072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201277.148234:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201277.148238:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.148239:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788201277.148243:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788201277.148293:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788201277.148309:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201277.148317:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.148327:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201277.148337:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201277.148340:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce09e1da800 from 7 10000000:01000000:0.0:1788201277.148344:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201277.148365:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.148372:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.148381:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201277.148394:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.148418:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.148437:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.148759:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681251200 00000100:00100000:0.0:1788201277.148764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681251200 00000100:00100000:0.0:1788201277.148783:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788201277.148788:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:6513:x1875064681251200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201277.148797:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201277.148808:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce080030000/0xf9b71aee44720539 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720532 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.148839:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce080030000/0xf9b71aee44720539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720532 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.148851:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce080030000/0xf9b71aee44720539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720532 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.148859:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce080030000, rc 0) 00000100:00100000:0.0:1788201277.148891:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681251200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.148897:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788201277.148925:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201277.148936:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.149058:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201277.149105:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.149131:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.149161:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.149177:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681251328 00000100:00100000:0.0:1788201277.149180:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681251328 00000100:00100000:0.0:1788201277.149198:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788201277.149203:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681251328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.149285:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681251328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.149291:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788201277.149317:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.149342:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.149375:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.149387:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.149398:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681251456 00000100:00100000:0.0:1788201277.149401:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681251456 00000100:00100000:0.0:1788201277.149416:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788201277.149422:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681251456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.151762:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681251456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2313us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.151776:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788201277.151797:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201277.163874:0:13795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13795:1875064681251584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201277.163966:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201277.164010:0:13795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf83733b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.164042:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681251584 00000100:00100000:0.0:1788201277.164050:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681251584 00000100:00100000:0.0:1788201277.164098:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788201277.164107:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:13795:x1875064681251584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.164244:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:13795:x1875064681251584:12345-0@lo:502:llog_process_th.0 Request processed in 137us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.164251:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788201277.164590:0:13795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13795:1875064681251584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201277.164623:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201277.164632:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201277.164635:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788201277.164641:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce09e1da800 00000020:00000080:1.0:1788201277.164643:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201277.164706:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201277.164710:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201277.164712:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788201277.164721:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201277.164724:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201277.164726:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788201277.164729:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce09e1da800 00000020:00000080:1.0:1788201277.164731:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788201277.164851:0:13795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13795:1875064681251712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201277.164889:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201277.164925:0:13795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf83733b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201277.164975:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681251712 00000100:00100000:0.0:1788201277.164979:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681251712 00000100:00100000:0.0:1788201277.165014:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788201277.165021:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:13795:x1875064681251712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.165099:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:13795:x1875064681251712:12345-0@lo:502:llog_process_th.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.165106:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788201277.165185:0:13795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13795:1875064681251712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201277.165204:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201277.165208:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201277.165210:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788201277.165213:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788201277.165356:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788201277.165374:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201277.165384:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.165395:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201277.165404:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201277.165406:0:6513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0889be000 from 7 10000000:01000000:0.0:1788201277.165409:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201277.165448:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.165455:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.165465:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201277.165478:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.165521:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.165550:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201277.165662:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681251840 00000100:00100000:1.0:1788201277.165668:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681251840 00000100:00100000:1.0:1788201277.165693:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788201277.165700:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:6513:x1875064681251840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201277.165709:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201277.165721:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720547 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44720540 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201277.165774:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44720540 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201277.165784:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44720540 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201277.165791:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255200, rc 0) 00000100:00100000:1.0:1788201277.165823:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681251840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201277.165835:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788201277.165984:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201277.165997:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.166005:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201277.166050:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.166074:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.166101:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201277.166141:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681251968 00000100:00100000:1.0:1788201277.166146:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681251968 00000100:00100000:1.0:1788201277.166186:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788201277.166193:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681251968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201277.166287:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681251968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201277.166294:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788201277.170089:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681251968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.170165:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681252096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.170233:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.170273:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201277.170413:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681252096 00000100:00100000:3.0:1788201277.170420:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681252096 00000100:00100000:3.0:1788201277.170471:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788201277.170481:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681252096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201277.170609:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:6513:x1875064681252096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201277.170617:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788201277.170785:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49adc14-d6d0-415b-83c4-8895eee6f8a8:6513:1875064681252096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201277.172954:0:13796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13796:1875064681252224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.173030:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.173073:0:13796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201277.174209:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681252224 00000100:00100000:3.0:1788201277.174219:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681252224 00000100:00100000:3.0:1788201277.174272:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788201277.174282:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:13796:x1875064681252224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201277.174429:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:13796:x1875064681252224:12345-0@lo:502:llog_process_th.0 Request processed in 149us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201277.174437:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788201277.176390:0:13796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13796:1875064681252224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201277.176440:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201277.176450:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.176452:0:13796:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201277.176457:0:13796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0889be000 00000020:00000080:0.0:1788201277.176460:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201277.176533:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201277.176813:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.176816:0:13796:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201277.176819:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201277.176822:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.176823:0:13796:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788201277.176827:0:13796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0889be000 00000020:00000080:0.0:1788201277.176829:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201277.176994:0:13796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13796:1875064681252352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201277.177055:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201277.177079:0:13796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201277.177486:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681252352 00000100:00100000:2.0:1788201277.177509:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681252352 00000100:00100000:2.0:1788201277.177554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788201277.177563:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:13796:x1875064681252352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201277.177686:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:13796:x1875064681252352:12345-0@lo:502:llog_process_th.0 Request processed in 124us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.177693:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788201277.177809:0:13796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49adc14-d6d0-415b-83c4-8895eee6f8a8:13796:1875064681252352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201277.177832:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201277.177837:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201277.177839:0:13796:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788201277.177843:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788201277.178142:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788201277.178170:0:6513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201277.178179:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201277.178189:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201277.184454:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788201277.219238:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788201277.558225:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681252480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201277.558306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201277.558589:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681252480 00000100:00100000:3.0:1788201277.558597:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681252480 00000100:00100000:3.0:1788201277.558696:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201277.558706:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681252480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201277.558729:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201277.558808:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681252480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201277.558815:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1788201277.558885:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823af100 x1875064681252480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.558904:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681252480:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201277.622311:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201277.634140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201277.634192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201277.634222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201277.634305:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662289920 00000100:00100000:3.0:1788201277.634315:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662289920 00000100:00100000:3.0:1788201277.634378:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 95 00000100:00100000:3.0:1788201277.634389:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662289920:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201277.634459:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662289920:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201277.634466:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 95 00000100:00100000:2.0:1788201277.635298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201277.635335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201277.635383:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662289536 00000100:00100000:3.0:1788201277.635388:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662289536 00000100:00100000:3.0:1788201277.635425:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 367 00000100:00100000:3.0:1788201277.635433:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662289536:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201277.635475:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b5a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662289536:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201277.635481:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 367 00000100:00080000:3.0:1788201277.635573:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201277.646312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201277.647433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662289664 00000100:00100000:0.0:1788201277.647445:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662289664 00000100:00100000:0.0:1788201277.647609:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662290176 00000100:00100000:0.0:1788201277.647613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662290176 00000100:00100000:0.0:1788201277.647647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662289792 00000100:00100000:0.0:1788201277.647650:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662289792 00000100:00100000:0.0:1788201277.647673:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 221 00000100:00100000:0.0:1788201277.647682:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662289664:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201277.647773:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662289664:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 91us (13644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.647797:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 221 00000100:00100000:0.0:1788201277.647814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 222 00000100:00100000:0.0:1788201277.647821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662290176:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201277.647849:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662290176:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (13626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.647854:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 222 00000100:00100000:0.0:1788201277.647866:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 223 00000100:00100000:0.0:1788201277.647872:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662289792:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201277.647896:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662289792:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (12561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.647902:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 223 00000100:00080000:0.0:1788201277.647939:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201277.647943:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201277.651541:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662290048 00000100:00100000:0.0:1788201277.651555:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662290048 00000100:00100000:0.0:1788201277.652327:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00100000:0.0:1788201277.652342:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662290048:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201277.652425:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662290048:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 87us (6122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.652433:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00080000:2.0:1788201277.652950:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788201278.198811:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788201278.263166:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788201278.652904:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201279.094357:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681252608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201279.094445:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201279.094461:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681252736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201279.094542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201279.094580:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681252608 00000100:00100000:1.0:1788201279.094712:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681252608 00000100:00100000:0.0:1788201279.094807:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681252736 00000100:00100000:1.0:1788201279.094814:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788201279.094818:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681252736 00000100:00100000:1.0:1788201279.094828:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681252608:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201279.094866:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000004:00000024:1.0:1788201279.094874:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788201279.094901:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681252736:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201279.094941:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681252608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201279.094952:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000004:00000024:0.0:1788201279.094955:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788201279.096854:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681252608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201279.102692:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681252736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7778us (8134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201279.102713:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201279.103010:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681252736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201279.607354:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201279.607385:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681252864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201279.607464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201279.607642:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681252864 00000100:00100000:1.0:1788201279.607651:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681252864 00000100:00100000:1.0:1788201279.607711:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201279.607722:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681252864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201279.607786:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201279.607831:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681252864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201279.607838:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788201279.607896:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201279.607933:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681252864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201279.609337:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681252992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201279.609414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201279.609616:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681252992 00000100:00100000:1.0:1788201279.609625:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681252992 00000100:00100000:1.0:1788201279.609691:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201279.609701:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681252992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201279.609718:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201279.609792:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681252992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201279.609798:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201279.609842:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681252992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201279.610010:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201279.672500:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201280.635111:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788201280.640176:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1788201280.693937:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201281.720894:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201282.166177:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681253120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.166209:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681253248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201282.166224:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681253504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201282.166480:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681253376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.169248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201282.169336:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681253760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.169434:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681253120 00000100:00100000:2.0:1788201282.169445:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681253120 00000100:00100000:2.0:1788201282.169511:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788201282.169521:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681253120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201282.169531:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201282.169572:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681254016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.169590:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681253120:12345-0@lo:400:kworker.0 Request processed in 68us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201282.169608:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201282.169630:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681254528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201282.169654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201282.169695:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681253504 00000100:00100000:0.0:1788201282.169699:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681253504 00000100:00100000:0.0:1788201282.169733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788201282.170190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201282.170203:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788201282.170232:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681253632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.170260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201282.170274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201282.170292:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681254272:0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.170324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201282.170347:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681254784:0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.170372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201282.170414:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681253760 00000100:00100000:3.0:1788201282.170420:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681253760 00000100:00100000:2.0:1788201282.170421:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681253120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.170452:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788201282.170461:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681254272 00000100:00100000:3.0:1788201282.170462:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681253760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.170466:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681254272 00000100:00100000:3.0:1788201282.170521:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681253760:12345-0@lo:400:kworker.0 Request processed in 61us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.170529:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788201282.170538:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681254784 00000100:00100000:2.0:1788201282.170543:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681254784 00000100:00100000:2.0:1788201282.170568:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201282.170576:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681254272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.170712:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681254016 00000100:00100000:3.0:1788201282.170717:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681254016 00000100:00100000:1.0:1788201282.170735:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681253888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201282.170786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201282.170805:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681254400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201282.170829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201282.170842:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681254528 00000100:00100000:3.0:1788201282.170847:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681254528 00000100:00100000:1.0:1788201282.170862:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681253248 00000100:00100000:3.0:1788201282.170865:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681253376 00000100:00100000:1.0:1788201282.170869:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681253248 00000100:00100000:3.0:1788201282.170870:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681253376 00000100:00100000:3.0:1788201282.170890:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681253888 00000100:00100000:3.0:1788201282.170892:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681253888 00000100:00100000:3.0:1788201282.170913:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681254400 00000100:00100000:3.0:1788201282.170915:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681254400 00000100:00100000:1.0:1788201282.170917:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201282.170928:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681253248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201282.170937:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788201282.170946:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681254016:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788201282.170958:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201282.170997:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681254016:12345-0@lo:400:kworker.0 Request processed in 52us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201282.171014:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681253248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.171015:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788201282.171028:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201282.171035:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788201282.171044:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681254528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201282.171056:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788201282.171067:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681253376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.171082:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681254528:12345-0@lo:400:kworker.0 Request processed in 40us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.171089:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788201282.171105:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788201282.171113:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681253888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.171154:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681253888:12345-0@lo:400:kworker.0 Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.171160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788201282.171170:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788201282.171176:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681254400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.171216:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681254400:12345-0@lo:400:kworker.0 Request processed in 40us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.171222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788201282.171261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201282.171284:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681254144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.171310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201282.171323:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681254656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.171345:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788201282.171373:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf823ad880 x1875064681253248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201282.171395:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681253248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201282.171424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681253632 00000100:00100000:3.0:1788201282.171428:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681253632 00000100:00100000:3.0:1788201282.171450:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788201282.171456:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681253632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201282.171476:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681253504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.171495:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681253632:12345-0@lo:400:kworker.0 Request processed in 37us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.171503:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201282.171529:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681253504:12345-0@lo:400:kworker.0 Request processed in 1788us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.171539:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681253632:0@lo:400:kworker.0 00000100:00100000:0.0:1788201282.171540:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788201282.171570:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681254144 00000100:00100000:0.0:1788201282.171574:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681254144 00000100:00100000:0.0:1788201282.171593:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681254656 00000100:00100000:0.0:1788201282.171596:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681254656 00000100:00100000:0.0:1788201282.171610:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201282.171618:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681254784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201282.171661:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681254784:12345-0@lo:400:kworker.0 Request processed in 44us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201282.171667:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201282.171684:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201282.171692:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681254144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.171713:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681253504:0@lo:400:kworker.0 00010000:00080000:3.0:1788201282.171730:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82604a80 x1875064681254016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201282.172499:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681254144:12345-0@lo:400:kworker.0 Request processed in 46us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201282.172510:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201282.172532:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788201282.172543:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681254656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201282.172598:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681254656:12345-0@lo:400:kworker.0 Request processed in 58us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201282.172604:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201282.172710:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681253376:12345-0@lo:400:kworker.0 Request processed in 52us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201282.172720:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788201282.172787:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681253376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201282.172802:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681253888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201282.172816:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681254400:0@lo:400:kworker.0 00000100:00080000:1.0:1788201282.172868:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201282.172874:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201282.172877:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201282.172880:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201282.172901:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681253760:0@lo:400:kworker.0 00010000:00080000:1.0:1788201282.172916:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e1c4a80 x1875064681254784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201282.172927:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681254784:0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.173898:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681254272:12345-0@lo:400:kworker.0 Request processed in 3316us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201282.173910:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201282.177973:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681254144:0@lo:400:kworker.0 00010000:00080000:0.0:1788201282.178000:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e1c5c00 x1875064681254656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201282.178014:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681254656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201282.184552:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788201282.184571:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf82396680, transno 4294967301 00000100:00100000:1.0:1788201282.184651:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681254272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201282.185469:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681254016:0@lo:400:kworker.0 00010000:00080000:3.0:1788201282.185506:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e1c5f80 x1875064681254528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201282.185517:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681254528:0@lo:400:kworker.0 00000100:00100000:2.0:1788201282.678274:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681254912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201282.678372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201282.679002:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681254912 00000100:00100000:1.0:1788201282.679013:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681254912 00000100:00100000:1.0:1788201282.679096:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201282.679108:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681254912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201282.679150:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201282.679236:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681254912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201282.679243:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1788201282.679525:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba2f3b80 x1875064681254912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201282.679548:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681254912:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201282.742063:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201282.755102:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201282.755167:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201282.755243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662290432 00000100:00100000:1.0:1788201282.755256:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662290432 00000100:00100000:3.0:1788201282.755257:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662290304 00000100:00100000:3.0:1788201282.755261:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662290304 00000100:00100000:3.0:1788201282.755325:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 369 00000100:00100000:1.0:1788201282.755333:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 231 00000100:00100000:3.0:1788201282.755336:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662290304:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201282.755340:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662290432:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201282.755434:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662290304:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 99us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.755442:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 369 00000100:00080000:2.0:1788201282.755925:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201282.756346:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662290432:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 1003us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201282.756356:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 231 00000100:00100000:3.0:1788201282.767596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201282.767787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201282.767820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201282.767841:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201282.767882:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662290560 00000100:00100000:2.0:1788201282.767882:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662290944 00000100:00100000:3.0:1788201282.767893:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662290560 00000100:00100000:2.0:1788201282.767893:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662290944 00000100:00100000:0.0:1788201282.767961:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662290816 00000100:00100000:0.0:1788201282.767966:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662290816 00000100:00100000:1.0:1788201282.768005:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662290688 00000100:00100000:1.0:1788201282.768010:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662290688 00000100:00100000:0.0:1788201282.768036:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 232 00000100:00100000:1.0:1788201282.768043:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00100000:0.0:1788201282.768047:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662290816:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201282.768049:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662290688:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201282.768144:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662290688:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 95us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.768149:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 233 00000100:00100000:1.0:1788201282.768152:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00100000:2.0:1788201282.768229:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 234 00000100:00100000:2.0:1788201282.768236:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662290944:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201282.770678:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662290560:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201282.772365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662290816:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 4304us (4507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201282.772406:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 232 00000100:00080000:0.0:1788201282.772510:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201282.772518:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201282.772521:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201282.775937:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662290944:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 7681us (8131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201282.775955:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 234 00000100:00100000:3.0:1788201282.776264:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662290560:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 8104us (8439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201282.776275:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 233 00010000:00010000:2.0:1788201283.765934:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201284.214375:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681255040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201284.214482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201284.214593:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201284.214600:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681255168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201284.214633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201284.218229:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681255040 00000100:00100000:2.0:1788201284.218237:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681255168 00000100:00100000:2.0:1788201284.218253:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681255168 00000100:00100000:2.0:1788201284.218364:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788201284.218377:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681255168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201284.218453:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788201284.218481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681255040 00000100:00100000:3.0:1788201284.218558:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201284.218569:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681255040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201284.218592:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788201284.219197:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681255168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201284.219219:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681255040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201284.220672:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681255040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2095us (6180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201284.220688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788201284.221369:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681255168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2988us (6730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201284.221381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788201284.726149:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681255296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201284.727093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201284.727359:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681255296 00000100:00100000:1.0:1788201284.727371:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681255296 00000100:00100000:1.0:1788201284.727451:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201284.727484:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681255296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201284.727529:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201284.728031:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681255296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 539us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201284.728040:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201284.728122:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681255296:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788201284.728269:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201284.728579:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681255424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201284.728636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201284.728728:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681255424 00000100:00100000:0.0:1788201284.728734:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681255424 00000100:00100000:0.0:1788201284.728818:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201284.728828:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681255424:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201284.728968:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788201284.729013:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201284.729144:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681255424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 318us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201284.729152:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201284.729243:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681255424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201284.792121:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201285.814562:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201286.838686:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201287.286038:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681255808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.286076:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681255936:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.286142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201287.286143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201287.286234:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681255552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201287.286315:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681255680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201287.291504:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201287.291566:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681256192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201287.291612:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201287.291643:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681256576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201287.291845:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681256320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.296349:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681255808 00000100:00100000:3.0:1788201287.296367:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681255808 00000100:00100000:3.0:1788201287.297173:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681256192 00000100:00100000:3.0:1788201287.297180:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681256192 00000100:00100000:3.0:1788201287.297209:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788201287.297218:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681255808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.297310:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681255808:12345-0@lo:400:kworker.0 Request processed in 93us (11170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.297331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788201287.297362:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788201287.297369:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681256192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.297404:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681256192:12345-0@lo:400:kworker.0 Request processed in 37us (5792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.297410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788201287.297447:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681256448:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.297489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201287.297527:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681256960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.297605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201287.297631:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681255936 00000100:00100000:3.0:1788201287.297635:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681255936 00000100:00100000:2.0:1788201287.302267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201287.302330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201287.302613:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681256576 00000100:00100000:2.0:1788201287.302622:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681256576 00000100:00100000:2.0:1788201287.302692:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201287.302704:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681256576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201287.302790:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681256576:12345-0@lo:400:kworker.0 Request processed in 90us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201287.302798:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201287.302958:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681256448 00000100:00100000:3.0:1788201287.302964:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681256448 00000100:00100000:3.0:1788201287.302989:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681256960 00000100:00100000:3.0:1788201287.302991:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681256960 00000100:00100000:3.0:1788201287.303007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681255680 00000100:00100000:3.0:1788201287.303010:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681255680 00000100:00100000:3.0:1788201287.303025:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788201287.303032:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681255936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303078:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681255936:12345-0@lo:400:kworker.0 Request processed in 46us (16938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.303097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788201287.303110:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788201287.303117:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681256448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303148:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681256448:12345-0@lo:400:kworker.0 Request processed in 31us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.303181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788201287.303194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788201287.303201:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681256960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303231:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681256960:12345-0@lo:400:kworker.0 Request processed in 32us (5682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.303236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788201287.303246:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788201287.303252:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681255680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303279:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681255680:12345-0@lo:400:kworker.0 Request processed in 27us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.303284:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00080000:3.0:1788201287.303332:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83713480 x1875064681256960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201287.303355:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681256960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303391:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681255936:0@lo:400:kworker.0 00010000:00080000:3.0:1788201287.303402:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50ca80 x1875064681256448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201287.303411:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681256448:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303422:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201287.303432:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681256832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201287.303496:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681256832 00000100:00100000:3.0:1788201287.303499:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681256832 00000100:00100000:3.0:1788201287.303528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788201287.303534:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681256832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303564:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681256832:12345-0@lo:400:kworker.0 Request processed in 31us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.303569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788201287.303592:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681256832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303642:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681255680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303651:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681256064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201287.303676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201287.303702:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681256064 00000100:00100000:3.0:1788201287.303705:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681256064 00000100:00100000:3.0:1788201287.303774:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201287.303780:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681256064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201287.303804:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201287.303834:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681256064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.303839:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1788201287.303867:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba2f3b80 x1875064681256064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201287.303883:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681256064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201287.303890:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681256704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303916:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201287.303945:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681257216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.303966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201287.304024:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201287.304029:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201287.304031:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201287.304033:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201287.304048:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681256704 00000100:00100000:3.0:1788201287.304053:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681256704 00000100:00100000:3.0:1788201287.304078:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681257216 00000100:00100000:3.0:1788201287.304092:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681257216 00000100:00100000:3.0:1788201287.304106:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201287.304111:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681256704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.304148:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681256704:12345-0@lo:400:kworker.0 Request processed in 36us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.304153:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201287.304164:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201287.304169:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681257216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.304196:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681257216:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.304202:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788201287.304214:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201287.304231:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681256704:0@lo:400:kworker.0 00010000:00080000:3.0:1788201287.304241:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834b0700 x1875064681257216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201287.304248:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681257216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.304294:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681255552 00000100:00100000:3.0:1788201287.304297:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681255552 00000100:00100000:3.0:1788201287.304323:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788201287.304330:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681255552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.304376:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681255552:12345-0@lo:400:kworker.0 Request processed in 47us (12881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.304383:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788201287.305441:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681256576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201287.305455:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681257088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201287.305505:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201287.305564:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681255552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201287.305576:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681256192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201287.305700:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681257088 00000100:00100000:2.0:1788201287.305713:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681257088 00000100:00100000:2.0:1788201287.305784:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788201287.305792:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681257088:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201287.305873:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201287.305879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201287.305987:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681256320 00000100:00100000:0.0:1788201287.305992:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681256320 00000100:00100000:0.0:1788201287.306032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788201287.306039:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681256320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201287.310004:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681255808:0@lo:400:kworker.0 00000100:00080000:1.0:1788201287.310094:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201287.312229:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681257088:12345-0@lo:400:kworker.0 Request processed in 6427us (6712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201287.312248:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1788201287.320181:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83710e00 x1875064681257088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201287.320201:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681257088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201287.320898:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681256320:12345-0@lo:400:kworker.0 Request processed in 14854us (15015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201287.320913:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788201287.322145:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681256320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201287.800311:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201287.805748:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681257344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201287.805836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201287.806445:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681257344 00000100:00100000:0.0:1788201287.806468:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681257344 00000100:00100000:0.0:1788201287.806530:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788201287.806541:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681257344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201287.806567:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201287.806637:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681257344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201287.806645:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1788201287.806903:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8362d880 x1875064681257344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201287.806924:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681257344:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201287.862872:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201287.877913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201287.877953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201287.877989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201287.878033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201287.878054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201287.878087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201287.878118:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662291328 00000100:00100000:0.0:1788201287.878128:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662291328 00000100:00100000:0.0:1788201287.878183:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662291584 00000100:00100000:0.0:1788201287.878186:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662291584 00000100:00100000:0.0:1788201287.878199:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662291200 00000100:00100000:0.0:1788201287.878201:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662291200 00000100:00100000:0.0:1788201287.878212:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662291712 00000100:00100000:0.0:1788201287.878214:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662291712 00000100:00100000:0.0:1788201287.878230:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 241 00000100:00100000:0.0:1788201287.878240:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662291328:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201287.878331:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662291328:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201287.878338:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 241 00000100:00100000:0.0:1788201287.878355:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 242 00000100:00100000:0.0:1788201287.878360:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662291584:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201287.878385:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662291584:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201287.878391:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 242 00000100:00100000:0.0:1788201287.878402:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:0.0:1788201287.878409:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662291200:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201287.878431:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662291200:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 22us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201287.878437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:0.0:1788201287.878448:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:0.0:1788201287.878481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662291712:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201287.878507:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662291712:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201287.878514:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00080000:1.0:1788201287.878622:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201287.878626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201287.879495:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662291072 00000100:00100000:3.0:1788201287.879503:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662291072 00000100:00100000:3.0:1788201287.879593:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 371 00000100:00100000:3.0:1788201287.879602:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662291072:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201287.879657:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662291072:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 56us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201287.879663:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 371 00000100:00100000:0.0:1788201287.879842:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662291456 00000100:00100000:0.0:1788201287.879847:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662291456 00000100:00100000:0.0:1788201287.879899:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 105 00000100:00100000:0.0:1788201287.879907:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662291456:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201287.879942:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662291456:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 36us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201287.879948:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 105 00000100:00080000:1.0:1788201287.880127:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788201288.438601:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788201288.503821:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788201288.885967:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201289.334395:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201289.334417:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681257472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201289.334480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201289.334517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681257472 00000100:00100000:2.0:1788201289.334523:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681257472 00000100:00100000:2.0:1788201289.334566:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201289.334575:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681257472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201289.334608:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201289.334648:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681257472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201289.334655:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201289.334722:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e12fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681257472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201289.334802:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681257600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201289.334832:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201289.335412:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681257600 00000100:00100000:2.0:1788201289.335418:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681257600 00000100:00100000:2.0:1788201289.335453:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201289.335461:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681257600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201289.335481:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201289.335521:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681257600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201289.335527:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201289.335573:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681257600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201289.846247:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201289.846272:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681257728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201289.846361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201289.846641:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681257728 00000100:00100000:1.0:1788201289.846648:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681257728 00000100:00100000:1.0:1788201289.846713:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201289.846723:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681257728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201289.846785:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201289.846838:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681257728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201289.846844:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788201289.847260:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201289.847304:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681257728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201289.847502:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681257856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201289.847536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201289.847615:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681257856 00000100:00100000:0.0:1788201289.847620:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681257856 00000100:00100000:0.0:1788201289.847663:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201289.847672:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681257856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201289.847686:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201289.847733:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681257856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201289.847764:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201289.847841:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681257856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201289.847987:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201289.909913:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201290.934327:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201291.957993:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201292.406704:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681258240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.406826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.406893:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681258752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.406917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.406973:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681259264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.406995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407018:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201292.407023:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681258112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407071:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681258624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407110:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681259136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407159:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681258752 00000100:00100000:0.0:1788201292.407167:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681258752 00000100:00100000:0.0:1788201292.407218:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681259264 00000100:00100000:0.0:1788201292.407221:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681259264 00000100:00100000:0.0:1788201292.407234:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681258112 00000100:00100000:0.0:1788201292.407235:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681258112 00000100:00100000:0.0:1788201292.407245:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681258624 00000100:00100000:0.0:1788201292.407247:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681258624 00000100:00100000:0.0:1788201292.407256:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681259136 00000100:00100000:0.0:1788201292.407258:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681259136 00000100:00100000:0.0:1788201292.407271:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788201292.407280:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681258752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681258752:12345-0@lo:400:kworker.0 Request processed in 58us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.407345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788201292.407363:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788201292.407368:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681259264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407391:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681259264:12345-0@lo:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.407406:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788201292.407417:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788201292.407421:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681258112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407447:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681258112:12345-0@lo:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.407453:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788201292.407462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788201292.407467:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681258624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407489:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681258624:12345-0@lo:400:kworker.0 Request processed in 22us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.407494:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788201292.407503:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788201292.407507:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681259136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407527:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681259136:12345-0@lo:400:kworker.0 Request processed in 20us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.407533:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788201292.407578:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681258112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407587:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681258624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407595:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681259136:0@lo:400:kworker.0 00010000:00080000:0.0:1788201292.407608:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf50df80 x1875064681258752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201292.407618:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681258752:0@lo:400:kworker.0 00010000:00080000:0.0:1788201292.407626:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83710e00 x1875064681259264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201292.407641:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681259264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407673:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681258368:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407727:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681258880:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407793:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681259392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407828:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788201292.407833:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681257984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407876:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681258496:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407908:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681259008:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407940:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681259520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.407960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.407983:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681258880 00000100:00100000:0.0:1788201292.407986:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681258880 00000100:00100000:0.0:1788201292.408008:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681259392 00000100:00100000:0.0:1788201292.408010:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681259392 00000100:00100000:0.0:1788201292.408019:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681259008 00000100:00100000:0.0:1788201292.408021:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681259008 00000100:00100000:0.0:1788201292.408030:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681259520 00000100:00100000:0.0:1788201292.408031:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681259520 00000100:00100000:0.0:1788201292.408043:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788201292.408070:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681258880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.408111:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681258880:12345-0@lo:400:kworker.0 Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.408118:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788201292.408130:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201292.408135:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681259392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.408159:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681259392:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.408165:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201292.408174:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201292.408179:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681259008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.408201:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681259008:12345-0@lo:400:kworker.0 Request processed in 22us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.408207:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201292.408215:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201292.408220:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681259520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.408241:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681259520:12345-0@lo:400:kworker.0 Request processed in 21us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.408246:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201292.408264:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681258368 00000100:00100000:0.0:1788201292.408267:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681258368 00000100:00100000:0.0:1788201292.408286:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788201292.408291:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681258368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.408318:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681258368:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.408332:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788201292.408360:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681259008:0@lo:400:kworker.0 00010000:00080000:0.0:1788201292.408370:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf551500 x1875064681259520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201292.408378:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681259520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.408387:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681258368:0@lo:400:kworker.0 00000100:00100000:0.0:1788201292.408395:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681258880:0@lo:400:kworker.0 00010000:00080000:0.0:1788201292.408403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83713480 x1875064681259392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201292.408411:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681259392:0@lo:400:kworker.0 00000100:00080000:2.0:1788201292.408590:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201292.408595:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201292.408597:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201292.408600:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201292.408615:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681258240 00000100:00100000:2.0:1788201292.408619:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681258240 00000100:00100000:2.0:1788201292.408652:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681258496 00000100:00100000:2.0:1788201292.408655:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681258496 00000100:00100000:2.0:1788201292.408668:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788201292.408674:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681258240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201292.408719:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681258240:12345-0@lo:400:kworker.0 Request processed in 45us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201292.408725:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788201292.408766:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201292.408772:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681258496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201292.408803:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681258496:12345-0@lo:400:kworker.0 Request processed in 32us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201292.408809:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201292.408835:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681258240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201292.408867:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681258496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201292.409076:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681257984 00000100:00100000:3.0:1788201292.409081:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681257984 00000100:00100000:3.0:1788201292.409120:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788201292.409127:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681257984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201292.409171:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681257984:12345-0@lo:400:kworker.0 Request processed in 45us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201292.409176:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788201292.409215:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681257984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201292.409468:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681259648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201292.409514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201292.409580:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681259648 00000100:00100000:0.0:1788201292.409585:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681259648 00000100:00100000:0.0:1788201292.409622:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201292.409629:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681259648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201292.409653:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201292.410788:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681259648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1150us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201292.410800:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1788201292.410911:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8362f480 x1875064681259648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201292.410979:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681259648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201292.919720:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201292.919889:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681259776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201292.920120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201292.920587:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681259776 00000100:00100000:3.0:1788201292.920597:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681259776 00000100:00100000:3.0:1788201292.920729:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201292.920795:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681259776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201292.920827:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201292.920897:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681259776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201292.920904:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1788201292.920984:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8362fb80 x1875064681259776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201292.921005:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681259776:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201292.981964:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201292.993962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201292.994004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201292.994068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201292.994181:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662292096 00000100:00100000:1.0:1788201292.994191:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662292096 00000100:00100000:1.0:1788201292.994255:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662291968 00000100:00100000:1.0:1788201292.994259:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662291968 00000100:00100000:1.0:1788201292.994280:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 251 00000100:00100000:1.0:1788201292.994301:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662292096:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201292.994388:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662292096:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 99us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201292.994396:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 251 00000100:00100000:1.0:1788201292.994413:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 252 00000100:00100000:1.0:1788201292.994420:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662291968:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201292.994447:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662291968:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201292.994453:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 252 00000100:00100000:3.0:1788201292.994793:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662291840 00000100:00100000:3.0:1788201292.994798:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662291840 00000100:00100000:3.0:1788201292.994837:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 373 00000100:00100000:3.0:1788201292.994844:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662291840:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201292.994874:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662291840:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 31us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201292.994880:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 373 00000100:00080000:0.0:1788201292.995277:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201292.995282:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201293.013500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201293.013545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201293.013638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201293.013960:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662292224 00000100:00100000:3.0:1788201293.013972:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662292224 00000100:00100000:3.0:1788201293.014067:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1788201293.014079:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2397:x1875064662292224:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:3.0:1788201293.014121:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472046e 00000100:00080000:3.0:1788201293.014130:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9733800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201293.014183:0:8432:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788201293.014364:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+2:2397:x1875064662292224:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 288us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201293.014381:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00010000:00010000:3.0:1788201293.014401:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201293.015208:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201293.016165:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662292352 00000100:00100000:1.0:1788201293.016176:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662292352 00000100:00100000:1.0:1788201293.016313:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662292480 00000100:00100000:1.0:1788201293.016318:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662292480 00000100:00100000:1.0:1788201293.016348:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 253 00000100:00100000:1.0:1788201293.016583:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662292352:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201293.016651:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 254 00000100:00100000:1.0:1788201293.016660:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662292352:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 83us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.016661:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662292480:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201293.016667:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 253 00000100:00080000:1.0:1788201293.016699:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201293.016704:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201293.017063:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662292480:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 403us (3515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.017071:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 254 00010000:00010000:2.0:1788201294.005974:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201294.454219:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201294.457409:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681260032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201294.457609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201294.457826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681259904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201294.457867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201294.458532:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681260032 00000100:00100000:2.0:1788201294.458544:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681260032 00000100:00100000:2.0:1788201294.458605:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681259904 00000100:00100000:2.0:1788201294.458608:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681259904 00000100:00100000:2.0:1788201294.458628:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788201294.458638:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681260032:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201294.458722:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201294.458731:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681259904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201294.459155:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201294.459235:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681259904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 506us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201294.459244:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201294.459302:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681259904:0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201294.459558:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788201294.459606:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681260032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 970us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201294.459612:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788201294.459690:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681260032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201294.965914:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681260160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201294.967241:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201294.967381:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681260160 00000100:00100000:0.0:1788201294.967391:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681260160 00000100:00100000:0.0:1788201294.967463:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201294.967475:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681260160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201294.967509:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201294.967577:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681260160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201294.967584:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201294.967629:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681260160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201294.967722:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201294.969784:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201294.969805:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681260288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201294.969896:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201294.973673:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681260288 00000100:00100000:1.0:1788201294.973686:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681260288 00000100:00100000:1.0:1788201294.973877:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788201294.973900:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681260288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201294.973935:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201294.975470:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681260288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1579us (5576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201294.975497:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201294.976059:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681260288:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201294.979413:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201295.030948:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201296.054179:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201297.078889:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201297.527041:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681260416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201297.527112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.527186:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681260416 00000100:00100000:2.0:1788201297.527193:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681260416 00000100:00100000:2.0:1788201297.527242:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201297.527251:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681260416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201297.527278:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201297.527330:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681260416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.527338:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788201297.527363:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201297.527379:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681260544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.527457:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681261056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.527506:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681260672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527516:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681261568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.527578:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201297.527583:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681260928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527609:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681260544 00000100:00100000:2.0:1788201297.527613:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681260544 00000100:00100000:2.0:1788201297.527640:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788201297.527646:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681260544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527677:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681260544:12345-0@lo:400:kworker.0 Request processed in 31us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.527683:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788201297.527707:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681261056 00000100:00100000:2.0:1788201297.527711:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681261056 00000100:00100000:2.0:1788201297.527732:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201297.527756:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681261056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527785:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681261056:12345-0@lo:400:kworker.0 Request processed in 48us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.527791:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201297.527810:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681261568 00000100:00100000:2.0:1788201297.527813:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681261568 00000100:00100000:2.0:1788201297.527840:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201297.527846:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681261568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527873:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681261568:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.527887:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201297.527888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.527922:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681260672 00000100:00100000:2.0:1788201297.527927:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681260672 00000100:00100000:0.0:1788201297.527927:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681261184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.527957:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201297.527965:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681260672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201297.527978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.528003:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681260672:12345-0@lo:400:kworker.0 Request processed in 39us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.528022:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201297.528033:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681261184 00000100:00100000:2.0:1788201297.528036:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681261184 00000100:00100000:2.0:1788201297.528057:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788201297.528062:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681261184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528087:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681261184:12345-0@lo:400:kworker.0 Request processed in 25us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.528092:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:2.0:1788201297.528124:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201297.528128:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201297.528152:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82607800 x1875064681260416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201297.528171:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681260416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201297.528194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.528212:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681261440:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.528247:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681261952:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.528274:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681261696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528293:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681261568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528306:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681261056:0@lo:400:kworker.0 00000100:00100000:0.0:1788201297.528311:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.528322:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681260544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528355:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681260928 00000100:00100000:2.0:1788201297.528359:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681260928 00000100:00100000:2.0:1788201297.528381:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681261696 00000100:00100000:2.0:1788201297.528383:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681261696 00000100:00100000:2.0:1788201297.528402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788201297.528408:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681260928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201297.528427:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681260672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528448:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681260928:12345-0@lo:400:kworker.0 Request processed in 39us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.528449:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681261184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528461:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788201297.528471:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201297.528480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788201297.528483:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681260800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528491:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681261696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528516:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681261696:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.528521:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788201297.528537:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681261440 00000100:00100000:2.0:1788201297.528540:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681261440 00000100:00100000:2.0:1788201297.528557:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681261952 00000100:00100000:2.0:1788201297.528560:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681261952 00000100:00100000:2.0:1788201297.528579:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201297.528586:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681261440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201297.528592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.528627:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681261312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528628:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681261440:12345-0@lo:400:kworker.0 Request processed in 42us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.528641:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201297.528661:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201297.528667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.528672:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681261952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201297.528695:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681261824:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528707:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681261952:12345-0@lo:400:kworker.0 Request processed in 36us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.528713:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201297.528729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.528763:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681261312 00000100:00100000:2.0:1788201297.528767:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681261312 00000100:00100000:2.0:1788201297.528789:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681261824 00000100:00100000:0.0:1788201297.528790:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681261696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528793:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681261824 00000100:00100000:2.0:1788201297.528813:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788201297.528820:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681261312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528854:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681261312:12345-0@lo:400:kworker.0 Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.528861:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788201297.528875:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00010000:00080000:0.0:1788201297.528880:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83716680 x1875064681261312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201297.528885:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681261824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201297.528901:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681261312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.528925:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681261824:12345-0@lo:400:kworker.0 Request processed in 42us (197us total) trans 0 rc 0/0 00010000:00080000:0.0:1788201297.528927:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8340b480 x1875064681261824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201297.528940:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788201297.528947:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681261824:0@lo:400:kworker.0 00000100:00080000:2.0:1788201297.528967:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201297.528971:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201297.528973:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201297.528975:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201297.528998:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681260928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201297.529006:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681261440:0@lo:400:kworker.0 00010000:00080000:2.0:1788201297.529029:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8340aa00 x1875064681261952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201297.529050:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681261952:0@lo:400:kworker.0 00000100:00100000:3.0:1788201297.529372:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681260800 00000100:00100000:3.0:1788201297.529377:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681260800 00000100:00100000:3.0:1788201297.529414:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788201297.529429:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681260800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201297.529485:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681260800:12345-0@lo:400:kworker.0 Request processed in 57us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.529491:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201297.529597:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681260800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201298.039569:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681262080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201298.039656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.039834:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681262080 00000100:00100000:1.0:1788201298.039843:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681262080 00000100:00100000:1.0:1788201298.039904:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201298.039915:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681262080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201298.039939:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201298.039985:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681262080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.039992:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1788201298.040194:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8362e680 x1875064681262080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201298.040212:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681262080:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201298.101961:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201298.117213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201298.117250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201298.117285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201298.117307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201298.117330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201298.117355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662292864 00000100:00100000:0.0:1788201298.117364:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662292864 00000100:00100000:0.0:1788201298.117425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662292736 00000100:00100000:0.0:1788201298.117429:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662292736 00000100:00100000:0.0:1788201298.117444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662293120 00000100:00100000:0.0:1788201298.117446:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662293120 00000100:00100000:0.0:1788201298.117461:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662292992 00000100:00100000:0.0:1788201298.117472:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662292992 00000100:00100000:0.0:1788201298.117494:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 261 00000100:00100000:0.0:1788201298.117504:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662292864:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201298.117577:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662292864:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 74us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.117583:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 261 00000100:00100000:0.0:1788201298.117601:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 262 00000100:00100000:0.0:1788201298.117607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662292736:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201298.117628:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662292736:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.117633:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 262 00000100:00100000:0.0:1788201298.117644:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 263 00000100:00100000:0.0:1788201298.117649:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662293120:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201298.117669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662293120:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 20us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.117675:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 263 00000100:00100000:0.0:1788201298.117686:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 264 00000100:00100000:0.0:1788201298.117692:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662292992:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201298.117714:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662292992:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 22us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.117719:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 264 00000100:00080000:0.0:1788201298.117950:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201298.117954:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201298.123170:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662292608 00000100:00100000:1.0:1788201298.123183:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662292608 00000100:00100000:1.0:1788201298.123247:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 375 00000100:00100000:1.0:1788201298.123258:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662292608:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201298.123344:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662292608:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 88us (6139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.123351:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 375 00000001:00100000:1.0:1788201298.566164:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:1.0:1788201298.566176:0:8425:0:(genops.c:906:class_export_put()) final put ffff9ce0b9736800/da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:2.0:1788201298.566350:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9736800/da566c69-17bd-4938-bc1e-8b9ba2633293 for lustre-OST0000 00000020:00000080:2.0:1788201298.566401:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b9733800 for lustre-OST0000 00000040:00080000:0.0:1788201298.679130:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788201298.747431:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788201299.126881:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201299.576337:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201299.576360:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681262208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201299.576428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201299.576495:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681262208 00000100:00100000:2.0:1788201299.576503:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681262208 00000100:00100000:2.0:1788201299.576547:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201299.576557:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681262208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201299.576590:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201299.576633:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681262208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201299.576641:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201299.576692:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681262208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201299.577624:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681262336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201299.577665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201299.579104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681262336 00000100:00100000:0.0:1788201299.579116:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681262336 00000100:00100000:0.0:1788201299.579174:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201299.579182:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681262336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201299.579215:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788201299.579290:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681262336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201299.579297:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788201299.579370:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681262336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201300.086482:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681262464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201300.086554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201300.086628:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201300.086635:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681262592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201300.086661:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201300.086815:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681262464 00000100:00100000:3.0:1788201300.086826:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681262464 00000100:00100000:3.0:1788201300.086881:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681262592 00000100:00100000:3.0:1788201300.086884:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681262592 00000100:00100000:3.0:1788201300.086902:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788201300.086910:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681262464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201300.086941:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201300.086989:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681262464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201300.087005:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788201300.087022:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788201300.087029:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681262592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201300.087039:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201300.087062:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681262592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201300.087068:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788201300.087225:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201300.087263:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681262592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201300.087277:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681262464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201300.149902:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201301.178952:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201301.410713:0:14058:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:34:59 (1788201299) 00010000:00010000:0.0:1788201302.198864:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201302.646075:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681262720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201302.646157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201302.646283:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681262720 00000100:00100000:2.0:1788201302.646291:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681262720 00000100:00100000:2.0:1788201302.646351:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788201302.646362:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681262720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201302.646391:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201302.646440:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681262720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201302.646447:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:2.0:1788201302.646501:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf83716300 x1875064681262720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201302.646519:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681262720:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201302.646764:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201302.647034:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681263104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201302.647096:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681263616:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201302.647142:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681264128:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201302.647193:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788201302.647200:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681262976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647222:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201302.647237:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681263488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201302.647272:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681264000:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201302.647322:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681263104 00000100:00100000:3.0:1788201302.647327:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681263104 00000100:00100000:3.0:1788201302.647361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201302.647368:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681263104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647412:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681263104:12345-0@lo:400:kworker.0 Request processed in 44us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201302.647419:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201302.647440:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681263616 00000100:00100000:3.0:1788201302.647443:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681263616 00000100:00100000:3.0:1788201302.647469:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681264128 00000100:00100000:3.0:1788201302.647472:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681264128 00000100:00100000:3.0:1788201302.647500:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681262976 00000100:00100000:3.0:1788201302.647503:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681262976 00000100:00100000:3.0:1788201302.647518:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681263488 00000100:00100000:3.0:1788201302.647520:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681263488 00000100:00100000:3.0:1788201302.647532:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681264000 00000100:00100000:3.0:1788201302.647535:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681264000 00000100:00100000:3.0:1788201302.647550:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788201302.647556:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681263616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647589:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681263616:12345-0@lo:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201302.647594:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788201302.647616:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788201302.647623:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681264128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647654:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681264128:12345-0@lo:400:kworker.0 Request processed in 32us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201302.647660:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788201302.647673:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788201302.647679:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681262976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.647704:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681262976:12345-0@lo:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201302.648244:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788201302.648262:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788201302.648272:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681263488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.648312:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681263488:12345-0@lo:400:kworker.0 Request processed in 42us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201302.648318:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788201302.648331:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788201302.648338:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681264000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.648365:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681264000:12345-0@lo:400:kworker.0 Request processed in 29us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201302.648371:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788201302.648414:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681262976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.648427:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681263488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.648437:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681264000:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.648448:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681263104:0@lo:400:kworker.0 00010000:00080000:3.0:1788201302.648478:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b94c4e00 x1875064681263616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201302.648490:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681263616:0@lo:400:kworker.0 00010000:00080000:3.0:1788201302.648501:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf521880 x1875064681264128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201302.648509:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681264128:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.648635:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681262848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.648695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201302.648767:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681263360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.648802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201302.648824:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681263872:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.648849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201302.648869:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788201302.648876:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681263232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.648910:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201302.648930:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681263744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.648953:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201302.648967:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681264256:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201302.649032:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681263360 00000100:00100000:1.0:1788201302.649037:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681263360 00000100:00100000:1.0:1788201302.649070:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788201302.649076:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681263360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649113:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681263360:12345-0@lo:400:kworker.0 Request processed in 37us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201302.649119:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788201302.649139:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681263872 00000100:00100000:1.0:1788201302.649143:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681263872 00000100:00100000:1.0:1788201302.649165:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681263744 00000100:00100000:1.0:1788201302.649168:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681263744 00000100:00100000:1.0:1788201302.649181:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681264256 00000100:00100000:1.0:1788201302.649182:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681264256 00000100:00100000:1.0:1788201302.649195:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201302.649200:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681263872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649229:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681263872:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201302.649244:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201302.649255:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201302.649260:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681263744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649286:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681263744:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201302.649291:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201302.649300:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201302.649305:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681264256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649330:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681264256:12345-0@lo:400:kworker.0 Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201302.649335:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201302.649365:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681263744:0@lo:400:kworker.0 00010000:00080000:1.0:1788201302.649375:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf521f80 x1875064681264256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201302.649384:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681264256:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649393:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681263360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649401:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681263872:0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649423:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681263232 00000100:00100000:1.0:1788201302.649426:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681263232 00000100:00100000:1.0:1788201302.649445:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201302.649451:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681263232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201302.649485:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681263232:12345-0@lo:400:kworker.0 Request processed in 35us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201302.649501:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201302.649526:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681263232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.649800:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681262848 00000100:00100000:3.0:1788201302.649804:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681262848 00000100:00100000:3.0:1788201302.649842:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788201302.649849:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681262848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201302.649889:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681262848:12345-0@lo:400:kworker.0 Request processed in 41us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201302.649895:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788201302.649930:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681262848:0@lo:400:kworker.0 00000100:00080000:0.0:1788201302.650729:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201302.650735:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201302.650762:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201302.650766:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201302.941005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201302.941230:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662293248 00000100:00100000:1.0:1788201302.941241:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662293248 00000100:00100000:1.0:1788201302.941329:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:1.0:1788201302.941340:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:11080:x1875064662293248:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201302.941361:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201302.941385:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472054e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc011 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201302.941461:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720555 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201302.941475:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201302.941487:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201302.941541:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201302.941545:0:10723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201302.941581:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201302.941605:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472054e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc011 expref: 7 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201302.941622:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc011 expref: 6 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201302.941650:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:1.0:1788201302.941652:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201302.941656:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201302.941721:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+6:11080:x1875064662293248:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 383us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201302.941728:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00080000:0.0:1788201302.942022:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201302.955107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201302.955251:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662293376 00000100:00100000:0.0:1788201302.955266:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662293376 00000100:00100000:0.0:1788201302.955347:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1788201302.955358:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:11081:x1875064662293376:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201302.955378:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201302.955402:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee4472055c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc018 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955466:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955480:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955490:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955504:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955512:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955518:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955591:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d000/0xf9b71aee44720571 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955599:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d000/0xf9b71aee44720571 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955624:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d000/0xf9b71aee44720571 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201302.955664:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201302.955668:0:8476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201302.955690:0:8476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d000/0xf9b71aee44720571 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955701:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955707:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955714:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955721:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ca00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201302.955725:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955732:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955804:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:0.0:1788201302.955808:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201302.955813:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955820:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955847:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955853:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955859:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955864:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201302.955867:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955873:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955882:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ce0b5adb200) 00010000:00010000:0.0:1788201302.955884:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201302.955886:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955892:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472056a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955921:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee4472055c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc018 expref: 8 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955934:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d000/0xf9b71aee44720571 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc018 expref: 7 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.955953:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce0b5adb300) 00010000:00010000:0.0:1788201302.955955:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201302.955958:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d000, rc 0) 00000100:00100000:0.0:1788201302.956032:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:11081:x1875064662293376:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 676us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201302.956039:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:3.0:1788201302.961421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201302.961550:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662293504 00000100:00100000:2.0:1788201302.961564:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662293504 00000100:00100000:2.0:1788201302.961648:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1788201302.961660:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:11081:x1875064662293504:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788201302.962017:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:11081:x1875064662293504:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 Request processed in 358us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201302.962025:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:3.0:1788201302.974327:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201302.974416:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662293760 00000100:00100000:0.0:1788201302.974431:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662293760 00000100:00100000:0.0:1788201302.974507:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1788201302.974517:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:11081:x1875064662293760:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201302.974539:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201302.974560:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720578 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc01f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.974650:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.974665:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.974677:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.980531:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.980557:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981161:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981299:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367de00/0xf9b71aee4472058d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981310:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367de00/0xf9b71aee4472058d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981318:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367de00/0xf9b71aee4472058d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201302.981328:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788201302.981725:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981734:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981762:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981768:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ca00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201302.981772:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981780:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981793:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce0b5adb300) 00010000:00010000:0.0:1788201302.981796:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201302.981810:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981816:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee4472057f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.981834:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.982436:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.982443:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.982448:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201302.982452:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.982460:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.982473:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ce0b5adb200) 00010000:00010000:0.0:1788201302.982476:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201302.982479:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.982485:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720586 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.984616:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720578 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc01f expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.984662:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367de00/0xf9b71aee4472058d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc01f expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201302.984671:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:0.0:1788201302.984674:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201302.984677:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367de00, rc 0) 00000100:00100000:0.0:1788201302.984774:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+9:11081:x1875064662293760:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 10257us (10459us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788201302.984782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1788201302.994103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201302.994393:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662293888 00000100:00100000:2.0:1788201302.994403:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662293888 00000100:00100000:2.0:1788201302.994465:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:2.0:1788201302.994475:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+9:11081:x1875064662293888:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788201302.994591:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+9:11081:x1875064662293888:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 110us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201302.994599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1788201302.997283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201302.997382:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662294016 00000100:00100000:1.0:1788201302.997391:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662294016 00000100:00100000:1.0:1788201302.997476:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:1.0:1788201302.997487:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:11081:x1875064662294016:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788201302.997594:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788201302.999931:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2404us 00000100:00100000:1.0:1788201303.026935:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:11081:x1875064662294016:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 29441us (29651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.026949:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:1.0:1788201303.157950:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201303.157983:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681264384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201303.158046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.158105:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681264384 00000100:00100000:1.0:1788201303.158112:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681264384 00000100:00100000:1.0:1788201303.158158:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788201303.158167:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681264384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201303.158190:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201303.158233:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681264384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.158252:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1788201303.158296:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf596680 x1875064681264384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201303.158313:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681264384:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201303.223324:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201303.235415:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201303.235529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201303.236706:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662294144 00000100:00100000:2.0:1788201303.236718:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662294144 00000100:00100000:2.0:1788201303.236814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 377 00000100:00100000:2.0:1788201303.236822:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2398:x1875064662294144:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201303.236898:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2398:x1875064662294144:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 77us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.236905:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 377 00000100:00100000:0.0:1788201303.240842:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662294272 00000100:00100000:0.0:1788201303.241078:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662294272 00000100:00080000:0.0:1788201303.241966:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201303.242174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 271 00000100:00100000:1.0:1788201303.242205:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662294272:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201303.242368:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662294272:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 183us (6960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.242376:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 271 00000100:00100000:3.0:1788201303.242443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201303.246467:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662294400 00000100:00100000:2.0:1788201303.246482:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662294400 00000100:00100000:2.0:1788201303.246615:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 272 00000100:00100000:2.0:1788201303.246626:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662294400:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201303.246721:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662294400:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 97us (4279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.246730:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 272 00000100:00080000:0.0:1788201303.247355:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788201303.799356:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788201303.863560:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788201304.251328:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201304.694143:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681264512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201304.694246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201304.694408:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681264512 00000100:00100000:2.0:1788201304.694420:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681264512 00000100:00100000:2.0:1788201304.695425:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788201304.695449:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681264512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201304.695612:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201304.695698:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681264512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 261us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201304.695706:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788201304.696074:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681264640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201304.697844:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681264512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201304.699233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201304.699566:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681264640 00000100:00100000:3.0:1788201304.699577:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681264640 00000100:00100000:3.0:1788201304.699648:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201304.699660:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681264640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201304.699723:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788201304.701129:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681264640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1463us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201304.701146:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201304.703059:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681264640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201305.025223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201305.025325:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662294528 00000100:00100000:0.0:1788201305.025338:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662294528 00000100:00100000:0.0:1788201305.025424:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:0.0:1788201305.025437:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+9:11123:x1875064662294528:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201305.025466:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201305.025493:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472059b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc026 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025595:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025611:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025627:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025644:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025652:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025659:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025713:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025722:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025730:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025763:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201305.025768:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025788:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025803:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:0.0:1788201305.025806:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201305.025813:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025820:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025834:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025840:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025846:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025852:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ce00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201305.025855:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025861:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025868:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ce0b25e5100) 00010000:00010000:0.0:1788201305.025871:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201305.025874:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025890:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025927:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472059b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc026 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025938:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:0.0:1788201305.025940:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201305.025944:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472059b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc026 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.025953:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d400, rc 0) 00000100:00080000:1.0:1788201305.026076:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201305.032986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+9:11123:x1875064662294528:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 7524us (7751us total) trans 0 rc 301/301 00000100:00100000:1.0:1788201305.033002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:2.0:1788201305.039416:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201305.039570:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662294784 00000100:00100000:0.0:1788201305.039589:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662294784 00000100:00100000:0.0:1788201305.039658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:0.0:1788201305.039671:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+9:11123:x1875064662294784:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:0.0:1788201305.039770:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201305.039806:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720555 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc011 expref: 9 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.039827:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:0.0:1788201305.039965:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201305.040245:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.040262:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.040286:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.040307:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.040315:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.040323:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.041921:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.041944:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.041965:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201305.041983:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000831a7439 reply state 00000000b6715bd3 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.041997:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042004:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:0.0:1788201305.042008:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201305.042011:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201305.042017:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788201305.042175:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042192:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042200:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042207:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201305.042212:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042221:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042233:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:0.0:1788201305.042235:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201305.042239:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042246:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447205b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201305.042265:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000831a7439 reply state 00000000b6715bd3 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042272:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.042278:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ce0b25e5300) 00010000:00010000:0.0:1788201305.042281:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201305.042283:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788201305.042424:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+10:11123:x1875064662294784:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 2751us (3018us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788201305.042439:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:2.0:1788201305.134979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201305.135179:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662294912 00000100:00100000:0.0:1788201305.135191:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662294912 00000100:00100000:0.0:1788201305.135352:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:0.0:1788201305.135366:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+10:11131:x1875064662294912:12345-192.168.203.2@tcp:101:lctl.0 00010000:00010000:0.0:1788201305.135402:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201305.135433:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447205c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc02d expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.135522:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447205cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.135539:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447205cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.135551:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447205cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201305.135619:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201305.135624:0:8476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201305.135666:0:8476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447205cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.136062:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447205c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc02d expref: 12 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.136148:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447205cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc02d expref: 11 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.136177:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:0.0:1788201305.136181:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201305.136185:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367c600, rc 0) 00000100:00100000:0.0:1788201305.136268:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+11:11131:x1875064662294912:12345-192.168.203.2@tcp:101:lctl.0 Request processed in 904us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201305.136277:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:2.0:1788201305.194487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201305.194608:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662295040 00000100:00100000:1.0:1788201305.194621:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662295040 00000100:00100000:1.0:1788201305.194704:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:1.0:1788201305.194717:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+11:11137:x1875064662295040:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201305.194783:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201305.194812:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447205d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc034 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.194920:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.194939:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.194952:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.194974:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.194983:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.194990:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195241:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee447205e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195251:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee447205e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195258:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee447205e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201305.195300:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788201305.195304:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201305.195347:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee447205e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195372:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195379:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195386:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195393:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201305.195398:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195406:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195420:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:1.0:1788201305.195423:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201305.195428:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195434:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195449:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195456:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195462:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195472:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201305.195475:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195482:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195491:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ce0b25e5300) 00010000:00010000:1.0:1788201305.195493:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201305.195495:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195501:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195531:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447205d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc034 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195543:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee447205e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc034 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.195550:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:1.0:1788201305.195553:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788201305.195555:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255600, rc 0) 00000100:00100000:1.0:1788201305.195895:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+12:11137:x1875064662295040:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1179us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201305.195904:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:1.0:1788201305.204608:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201305.204787:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662295296 00000100:00100000:0.0:1788201305.204800:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662295296 00000100:00100000:1.0:1788201305.205043:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:1.0:1788201305.205057:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+12:11137:x1875064662295296:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201305.205090:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201305.205125:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447205ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc03b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.205276:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.205294:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.205307:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.205325:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.205332:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.205338:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201305.207242:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00000100:00100000:2.0:1788201305.207475:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681264768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201305.207570:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201305.208103:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681264768 00000100:00100000:0.0:1788201305.208115:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681264768 00000100:00100000:0.0:1788201305.208182:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201305.208193:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681264768:12345-0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201305.208227:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:0.0:1788201305.208228:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:1.0:1788201305.208247:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208259:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201305.208285:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681264768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201305.208293:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1788201305.208314:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201305.208325:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208332:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208339:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208345:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00000100:00100000:0.0:1788201305.208361:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681264768:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201305.208364:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208373:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208387:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:1.0:1788201305.208390:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201305.208395:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208403:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447205f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201305.208419:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cff308b5 reply state 000000003734d632 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208432:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208438:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:1.0:1788201305.208446:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201305.208450:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201305.208498:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447205ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208514:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.208522:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0866cc700) 00010000:00010000:1.0:1788201305.208524:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201305.208527:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254e00, rc 0) 00000100:00100000:1.0:1788201305.208596:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11137:x1875064662295296:12345-192.168.203.2@tcp:101:bash.0 Request processed in 3542us (4004us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788201305.208604:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1788201305.209963:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681264896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201305.210550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201305.211142:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681264896 00000100:00100000:2.0:1788201305.211155:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681264896 00000100:00100000:2.0:1788201305.211245:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201305.211258:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681264896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201305.211297:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201305.211386:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681264896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.211395:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788201305.211760:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201305.212215:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681264896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201305.217678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201305.218110:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662295424 00000100:00100000:1.0:1788201305.218125:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662295424 00000100:00100000:1.0:1788201305.218187:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:1.0:1788201305.218199:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875064662295424:12345-192.168.203.2@tcp:8:bash.0 00010000:00080000:1.0:1788201305.218245:0:8485:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:1.0:1788201305.218285:0:8485:0:(genops.c:1406:class_connect()) connect: client da566c69-17bd-4938-bc1e-8b9ba2633293, cookie 0xf9b71aee44720612 00002000:00100000:1.0:1788201305.218300:0:8485:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli da566c69-17bd-4938-bc1e-8b9ba2633293/ffff9ce09005b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201305.218324:0:8485:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201305.218425:0:8485:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201305.218465:0:8485:0:(import.c:65:import_set_state_nolock()) ffff9ce090059000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201305.218562:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2397:x1875064662295424:12345-192.168.203.2@tcp:8:bash.0 Request processed in 363us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201305.218571:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:3.0:1788201305.225871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.226010:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662295552 00000100:00100000:2.0:1788201305.226024:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662295552 00000100:00100000:2.0:1788201305.226130:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00080000:0.0:1788201305.226134:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201305.226143:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:0:x1875064662295552:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201305.226167:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201305.226199:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc042 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201305.226231:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201305.226258:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788201305.226264:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201305.226275:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.226301:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.226338:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0e00, rc 0) 00000100:00100000:2.0:1788201305.226421:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:0:x1875064662295552:12345-192.168.203.2@tcp:101:bash.0 Request processed in 281us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.226429:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:0.0:1788201305.234708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201305.235062:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662295680 00000100:00100000:1.0:1788201305.235076:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662295680 00000100:00100000:1.0:1788201305.235152:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:1.0:1788201305.235164:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:11137:x1875064662295680:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201305.235189:0:8485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201305.235216:0:8485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc049 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.235257:0:8485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.235268:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201305.235274:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201305.235280:0:8485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.235323:0:8485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.235338:0:8485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 8 pid: 8431 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201305.235354:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf597100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8485:1875064681265024:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201305.238193:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201305.244075:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf597100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8485:1875064681265024:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201305.244143:0:8485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.244196:0:8485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254000, rc 0) 00000100:00100000:1.0:1788201305.244274:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:11137:x1875064662295680:12345-192.168.203.2@tcp:101:bash.0 Request processed in 9111us (9579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201305.244283:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1788201305.246370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201305.247912:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662295808 00000100:00100000:1.0:1788201305.247935:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662295808 00010000:00010000:0.0:1788201305.248136:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 8 pid: 8431 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201305.248280:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:0.0:1788201305.248292:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662295808:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201305.248314:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201305.248344:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 8 pid: 8431 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.248361:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 8 pid: 8431 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.248468:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720619 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc042 expref: 8 pid: 8431 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.248500:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201305.248506:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201305.248516:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.248527:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.248594:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201305.248614:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1875064681265152:192.168.203.2@tcp:105: 00000100:00100000:0.0:1788201305.248912:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201305.257368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.258021:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1875064681265152:192.168.203.2@tcp:105: 00010000:00010000:2.0:1788201305.258059:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201305.258286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662296064 00000100:00100000:1.0:1788201305.258295:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662296064 00000100:00100000:1.0:1788201305.258361:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:1.0:1788201305.258373:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11137:x1875064662296064:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:2.0:1788201305.258837:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662295808:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10544us (12476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.258848:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:1.0:1788201305.260598:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+16:11137:x1875064662296064:12345-192.168.203.2@tcp:35:bash.0 Request processed in 2211us (3229us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788201305.260615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00010000:00010000:0.0:1788201305.270596:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201305.328000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201305.328226:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662296320 00000100:00100000:0.0:1788201305.328239:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662296320 00000100:00100000:0.0:1788201305.328312:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:0.0:1788201305.328325:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+16:11147:x1875064662296320:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201305.328375:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201305.328402:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc050 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201305.328534:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788201305.328677:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720627 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc050 expref: 18 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.328696:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:0.0:1788201305.328700:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201305.328705:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc050 expref: 18 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.328723:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367cc00, rc 0) 00000100:00100000:0.0:1788201305.328887:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+17:11147:x1875064662296320:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 565us (901us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788201305.328896:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:0.0:1788201305.332053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201305.332298:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662296576 00000100:00100000:3.0:1788201305.332309:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662296576 00000100:00100000:3.0:1788201305.332369:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:3.0:1788201305.332381:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+17:11147:x1875064662296576:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1788201305.332950:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+18:11147:x1875064662296576:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 565us (906us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788201305.332969:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1788201305.417140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.417434:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662296704 00000100:00100000:2.0:1788201305.417448:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662296704 00000100:00100000:2.0:1788201305.417528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:2.0:1788201305.417541:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+18:11153:x1875064662296704:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201305.417573:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201305.417601:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc057 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.417995:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee4472063c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.418015:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee4472063c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.418030:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee4472063c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201305.418116:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788201305.418121:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201305.418150:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee4472063c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.418183:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc057 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.418209:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee4472063c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc057 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.418220:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201305.418224:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201305.418229:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0c00, rc 0) 00000100:00100000:2.0:1788201305.418362:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+19:11153:x1875064662296704:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 823us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.418371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:2.0:1788201305.428011:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201305.428237:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662296960 00000100:00100000:1.0:1788201305.428249:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662296960 00000100:00100000:1.0:1788201305.428323:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:1.0:1788201305.428336:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+19:11153:x1875064662296960:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201305.428364:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201305.428392:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720643 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc05e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.428540:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472064a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.428558:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472064a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.428593:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472064a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201305.428611:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788201305.428947:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720643 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc05e expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.428984:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472064a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc05e expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.428995:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0866cc700) 00010000:00010000:1.0:1788201305.428999:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201305.429003:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255400, rc 0) 00000100:00100000:1.0:1788201305.429074:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11153:x1875064662296960:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 740us (1079us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788201305.429084:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:1.0:1788201305.437046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201305.437094:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201305.437169:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662297344 00000100:00100000:3.0:1788201305.437182:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662297344 00000100:00100000:3.0:1788201305.437256:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:3.0:1788201305.437269:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11153:x1875064662297344:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201305.437303:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201305.437328:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720658 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc065 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.437480:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472065f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.437499:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472065f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.437529:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472065f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201305.437545:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788201305.437680:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720658 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc065 expref: 24 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.437702:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472065f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc065 expref: 23 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.437712:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0866cc700) 00010000:00010000:3.0:1788201305.437716:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788201305.437720:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb200, rc 0) 00000100:00100000:2.0:1788201305.437909:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662297088 00000100:00100000:2.0:1788201305.437916:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662297088 00000100:00100000:2.0:1788201305.437967:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1788201305.437976:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf597800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+24:2399:x1875064662297088:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201305.437988:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201305.438005:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472064a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc05e expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.438019:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0866cc700) 00010000:00010000:2.0:1788201305.438029:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201305.438083:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf597800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+23:2399:x1875064662297088:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 108us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.438092:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1788201305.438910:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+22:11153:x1875064662297344:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1638us (1809us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788201305.438922:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:1.0:1788201305.448262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.448355:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662297472 00000100:00100000:2.0:1788201305.448368:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662297472 00000100:00100000:2.0:1788201305.448446:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:2.0:1788201305.448459:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2401:x1875064662297472:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:2.0:1788201305.448520:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.448548:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.448560:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201305.448565:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201305.448571:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.448618:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.448635:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 7 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201305.448700:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875064681265280:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201305.449027:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0862d99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201305.455712:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875064681265280:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201305.455731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1788201305.455808:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201305.456941:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662297600 00000100:00100000:0.0:1788201305.456975:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662297600 00002000:00100000:0.0:1788201305.457029:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9cdf823aed80 x1875064662297600/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:426/0 lens 504/0 e 0 to 0 dl 1788201316 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201305.457041:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf823aed80 with x1875064662297600 ext(0->12) 00010000:00010000:0.0:1788201305.457051:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 8 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.457069:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 8 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201305.457077:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cdf823aed80 00000100:00100000:0.0:1788201305.457322:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:0.0:1788201305.457335:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662297600:12345-192.168.203.2@tcp:4:lfs.0 00000001:00100000:3.0:1788201305.467143:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000100:00100000:2.0:1788201305.469761:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2398:x1875064662297600:12345-192.168.203.2@tcp:4:lfs.0 Request processed in 12395us (14011us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788201305.469781:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00002000:00100000:2.0:1788201305.469794:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9cdf823aed80 x1875064662297600/t4294967300(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:426/0 lens 504/448 e 0 to 0 dl 1788201316 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201305.469804:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf823aed80 with x1875064662297600 ext(0->12) 00010000:00010000:2.0:1788201305.469816:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 9 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.469834:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 9 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201305.469842:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cdf823aed80 00000100:00100000:0.0:1788201305.479387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201305.479581:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662297728 00000100:00100000:1.0:1788201305.479594:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662297728 00010000:00010000:1.0:1788201305.479647:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 9 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201305.479707:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:1.0:1788201305.479719:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2400:x1875064662297728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201305.479943:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788201305.479975:0:13184:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788201305.479978:0:13184:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788201304 00002000:00010000:1.0:1788201305.479981:0:13184:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788201304 00002000:00010000:1.0:1788201305.479984:0:13184:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788201304 00002000:00010000:1.0:1788201305.479986:0:13184:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788201305.479993:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 9 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.480010:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 9 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.480040:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072ef4886/0xf9b71aee44720620 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc049 expref: 9 pid: 8485 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.480061:0:13184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201305.480066:0:13184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201305.480073:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.480084:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.480141:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201305.480197:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2400:x1875064662297728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 480us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201305.480206:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00010000:00010000:3.0:1788201305.480295:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.480307:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.480331:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.480341:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.480350:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.480366:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201305.480371:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.480380:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.480396:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.480405:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5ad480a/0xf9b71aee4472066d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201305.480462:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2401:x1875064662297472:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 32007us (32216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201305.480471:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:1.0:1788201305.483580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201305.486241:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662297984 00000100:00100000:0.0:1788201305.486269:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662297984 00000100:00100000:0.0:1788201305.486345:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:0.0:1788201305.486358:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+22:11153:x1875064662297984:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:0.0:1788201305.486460:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472065f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc065 expref: 22 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201305.486795:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788201305.486850:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788201305.487201:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788201305.487244:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.487262:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.487280:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.487323:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201305.487340:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 26 pid: 6515 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201305.487358:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875064681265408:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201305.487491:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201305.491555:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875064681265408:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201305.491592:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201305.493231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.494497:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662298112 00000100:00100000:2.0:1788201305.494512:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662298112 00010000:00010000:2.0:1788201305.494966:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 27 pid: 6515 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201305.495053:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:2.0:1788201305.495067:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf596a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+27:2399:x1875064662298112:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201305.495087:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201305.495096:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 27 pid: 6515 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.495111:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 27 pid: 6515 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.495138:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720604 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc03b expref: 27 pid: 6515 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.495156:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0866cc700) 00010000:00010000:2.0:1788201305.495163:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.495173:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.495181:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.495218:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201305.495251:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201305.495269:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201305.495291:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf596a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+26:2399:x1875064662298112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 229us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.495299:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000001:00080000:1.0:1788201305.495416:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1788201305.495571:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788201305.496530:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681265536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788201305.496616:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201305.496696:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba391c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201305.497001:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681265536 00000100:00100000:3.0:1788201305.497010:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681265536 00000100:00100000:3.0:1788201305.497113:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201305.497124:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681265536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788201305.497157:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201305.497248:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681265536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 126us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.497358:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681265536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788201305.497466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000001:00080000:2.0:1788201305.497576:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788201305.497656:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8340a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681265664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788201305.497839:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201305.497868:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba391a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201305.497962:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681265664 00000100:00100000:3.0:1788201305.497967:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681265664 00000100:00100000:3.0:1788201305.498011:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788201305.498018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681265664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788201305.498177:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1875064681265664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (485us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788201305.498185:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201305.498244:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8340a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681265664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788201305.498367:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788201305.498407:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.498420:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.498428:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.498436:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201305.498440:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.498449:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.498468:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0866cc700) 00010000:00010000:2.0:1788201305.498472:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788201305.498476:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.498496:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720674 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201305.498611:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788201305.498685:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788201305.502928:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385800186743ns, next at 386800176210ns, rc = 0 00000001:00080000:2.0:1788201305.502968:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788201305.503061:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0866cc700) 00010000:00010000:2.0:1788201305.503067:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788201305.503082:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472065f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc065 expref: 30 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201305.503781:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+29:11153:x1875064662297984:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 17385us (20172us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788201305.503794:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000020:00080000:2.0:1788201305.503803:0:6518:0:(tgt_main.c:807:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788201305.513978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.514083:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662298240 00000100:00100000:2.0:1788201305.514097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662298240 00000100:00100000:2.0:1788201305.514175:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:2.0:1788201305.514187:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+29:11153:x1875064662298240:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201305.514231:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201305.514261:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472067b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc06c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.514358:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472067b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc06c expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.514401:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472067b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc06c expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.514427:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201305.514430:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201305.514434:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0200, rc 0) 00000100:00100000:2.0:1788201305.514528:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:11153:x1875064662298240:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 342us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.514536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:0.0:1788201305.517574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.517679:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662298496 00000100:00100000:2.0:1788201305.517702:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662298496 00000100:00100000:2.0:1788201305.517812:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1788201305.517825:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf40850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:11153:x1875064662298496:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201305.518388:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf40850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+31:11153:x1875064662298496:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 563us (827us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788201305.518398:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:1.0:1788201305.590153:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.590221:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662298752 00000100:00100000:2.0:1788201305.590234:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662298752 00000100:00100000:2.0:1788201305.590372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:2.0:1788201305.590386:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+31:11163:x1875064662298752:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201305.590423:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201305.590450:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc073 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201305.590926:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788201305.591095:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720682 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc073 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.591114:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:2.0:1788201305.591118:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201305.591124:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc073 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.591141:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1600, rc 0) 00000100:00100000:2.0:1788201305.591319:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+32:11163:x1875064662298752:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 936us (1181us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788201305.591328:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1788201305.600209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.600301:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662298880 00000100:00100000:2.0:1788201305.600315:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662298880 00000100:00100000:2.0:1788201305.600465:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:2.0:1788201305.600479:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+32:11163:x1875064662298880:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:2.0:1788201305.600589:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.600611:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.600626:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.600641:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.600649:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.600676:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.600819:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601067:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601075:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201305.601139:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601155:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601162:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601171:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601178:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201305.601183:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601191:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601205:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201305.601217:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201305.601224:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601232:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720690 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601249:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601255:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601262:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601267:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201305.601270:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601276:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601283:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:2.0:1788201305.601286:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201305.601289:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601294:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601303:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601317:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601323:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601327:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201305.601330:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601336:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601344:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201305.601346:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201305.601348:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.601354:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472069e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201305.601469:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+32:11163:x1875064662298880:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 984us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.601478:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:0.0:1788201305.605588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.605676:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662299136 00000100:00100000:2.0:1788201305.605688:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662299136 00000100:00100000:2.0:1788201305.605811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1788201305.605824:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+32:11163:x1875064662299136:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201305.606146:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+33:11163:x1875064662299136:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 323us (571us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788201305.606162:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:0.0:1788201305.647623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.647728:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662299392 00000100:00100000:2.0:1788201305.647767:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662299392 00000100:00100000:2.0:1788201305.647838:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:2.0:1788201305.647851:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+33:11166:x1875064662299392:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201305.647896:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201305.647923:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447206a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc07a expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.648146:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.648165:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.648178:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.648193:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.648200:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.648207:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.648344:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.648374:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.649188:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201305.649205:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788201305.649887:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.649901:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.649909:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.649916:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201305.649922:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.649930:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650060:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201305.650065:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201305.650071:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650077:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447206ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650095:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650120:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650126:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650130:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201305.650133:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650139:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650148:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:3.0:1788201305.650151:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201305.650154:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650160:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee447206b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650225:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447206a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 36 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650241:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 35 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.650250:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201305.650253:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201305.650262:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1400, rc 0) 00000100:00100000:3.0:1788201305.650431:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+35:11166:x1875064662299392:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 2581us (2821us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788201305.650442:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:1.0:1788201305.658734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.659091:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662299520 00000100:00100000:2.0:1788201305.659104:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662299520 00000100:00100000:2.0:1788201305.659185:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:2.0:1788201305.659198:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+35:11166:x1875064662299520:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:2.0:1788201305.659292:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659313:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659325:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659374:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659394:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659401:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659408:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201305.659412:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659440:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659455:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201305.659466:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201305.659473:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.659479:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201305.659630:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+35:11166:x1875064662299520:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 434us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.659638:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:1.0:1788201305.666336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201305.666490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662299776 00000100:00100000:0.0:1788201305.666504:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662299776 00000100:00100000:0.0:1788201305.666579:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:0.0:1788201305.666592:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+35:11166:x1875064662299776:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1788201305.668123:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+36:11166:x1875064662299776:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 1522us (1801us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788201305.668137:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:1.0:1788201305.959407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.959497:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662300032 00000100:00100000:2.0:1788201305.959575:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662300032 00000100:00100000:2.0:1788201305.959663:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:2.0:1788201305.959676:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+36:11197:x1875064662300032:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1788201305.959709:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201305.959773:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc081 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.959919:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447206d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.959937:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447206d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.960095:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447206d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201305.960127:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788201305.960625:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc081 expref: 39 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.960650:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447206d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc081 expref: 38 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201305.960660:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201305.960664:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201305.960668:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1200, rc 0) 00000100:00100000:2.0:1788201305.960863:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+38:11197:x1875064662300032:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1188us (1478us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788201305.960874:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:1.0:1788201305.969280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201305.969359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201305.969462:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662300288 00000100:00100000:2.0:1788201305.969475:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662300288 00000100:00100000:2.0:1788201305.969551:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1788201305.969572:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+38:11197:x1875064662300288:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1788201305.970260:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+39:11197:x1875064662300288:12345-192.168.203.2@tcp:35:cat.0 Request processed in 685us (989us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788201305.970270:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1788201305.970411:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662300416 00000100:00100000:3.0:1788201305.970417:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662300416 00000100:00100000:3.0:1788201305.970475:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:3.0:1788201305.970484:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+39:2400:x1875064662300416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201305.970499:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201305.970532:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447206d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc081 expref: 39 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201305.970566:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201305.970572:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201305.970596:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+38:2400:x1875064662300416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 115us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201305.970604:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1788201306.070273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201306.070335:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662300672 00000100:00100000:3.0:1788201306.070348:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662300672 00000100:00100000:3.0:1788201306.070425:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:3.0:1788201306.070437:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+38:11203:x1875064662300672:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:3.0:1788201306.070472:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201306.070476:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201306.070511:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee4472063c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc057 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.070536:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201306.070571:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201306.070591:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447206e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc088 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.070810:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.070830:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 38 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.070840:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.070966:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 38 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.070983:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 38 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201306.071016:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681265792:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201306.071149:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201306.077483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201306.077915:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662300800 00000100:00100000:0.0:1788201306.077927:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662300800 00010000:00010000:0.0:1788201306.077987:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 39 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201306.078056:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1788201306.078068:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+39:2399:x1875064662300800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201306.078098:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201306.078107:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 39 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.078122:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 39 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.078150:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:0.0:1788201306.078156:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.078167:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.078176:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.078198:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201306.078266:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+39:2399:x1875064662300800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 200us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201306.078275:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00010000:00010000:2.0:1788201306.079170:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447206ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc07a expref: 38 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201306.079204:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681265792:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201306.079232:0:8476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.079242:0:8476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.079248:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201306.079279:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788201306.079694:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447206e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 39 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.079713:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 38 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.079722:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201306.079725:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201306.079728:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba600, rc 0) 00000100:00100000:2.0:1788201306.079928:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+38:11203:x1875064662300672:12345-192.168.203.2@tcp:101:dd.0 Request processed in 9492us (9668us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788201306.079966:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:1.0:1788201306.082426:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201306.082895:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662300928 00000100:00100000:2.0:1788201306.082906:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662300928 00000100:00100000:2.0:1788201306.083030:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:2.0:1788201306.083042:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+38:11203:x1875064662300928:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1788201306.083068:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201306.083092:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc08f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.083144:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.083161:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.083173:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.083310:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee447206f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.083328:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.083349:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201306.083353:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201306.083356:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0c00, rc 0) 00000100:00100000:2.0:1788201306.083421:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+39:11203:x1875064662300928:12345-192.168.203.2@tcp:101:dd.0 Request processed in 382us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.083446:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:1.0:1788201306.088054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201306.089003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662301184 00000100:00100000:0.0:1788201306.089015:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662301184 00000100:00100000:1.0:1788201306.089663:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:1.0:1788201306.089677:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+39:11203:x1875064662301184:12345-192.168.203.2@tcp:36:dd.0 00010000:00010000:1.0:1788201306.089995:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.090032:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.090044:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201306.090090:0:6516:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1788201306.090128:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbf662b0 reply state 000000000865a2db transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.090141:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.090148:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:1.0:1788201306.090151:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201306.090155:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201306.090900:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+42:11203:x1875064662301184:12345-192.168.203.2@tcp:36:dd.0 Request processed in 1222us (2851us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1788201306.090910:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000020:00080000:1.0:1788201306.090915:0:6516:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788201306.293907:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201306.386085:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201306.386198:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662301312 00000100:00100000:2.0:1788201306.386207:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662301312 00000100:00100000:2.0:1788201306.386403:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:2.0:1788201306.386416:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+42:11217:x1875064662301312:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:2.0:1788201306.386441:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201306.386463:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee4472070e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc096 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.386529:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.386543:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.386553:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.386565:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.386572:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.386579:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.387872:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.387912:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 43 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.387922:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.387969:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 43 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.387985:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 43 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201306.388000:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681265920:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201306.388121:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201306.396927:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681265920:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201306.396970:0:8476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201306.401167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201306.401551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662301568 00000100:00100000:0.0:1788201306.401560:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662301568 00000100:00100000:0.0:1788201306.401624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:0.0:1788201306.401634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+44:6168:x1875064662301568:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788201306.401982:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+45:6168:x1875064662301568:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 349us (825us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788201306.401991:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:2.0:1788201306.407273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201306.407410:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662301696 00000100:00100000:0.0:1788201306.407420:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662301696 00010000:00010000:0.0:1788201306.407477:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 45 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201306.407638:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:0.0:1788201306.407650:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+45:2399:x1875064662301696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201306.407666:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201306.407674:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 45 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.407689:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 45 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.407712:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee447206eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc088 expref: 45 pid: 8476 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.407728:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:0.0:1788201306.407807:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.407820:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.407827:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.407859:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201306.407886:0:8476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.407893:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201306.407914:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+44:2399:x1875064662301696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 267us (650us total) trans 0 rc 0/0 00000004:00200000:2.0:1788201306.408086:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788201306.408091:0:8476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201306.408129:0:8476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408141:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408161:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408168:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408174:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408180:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201306.408183:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408190:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408199:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201306.408201:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201306.408205:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408212:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720715 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408221:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408227:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408233:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408245:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201306.408248:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408254:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408265:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:2.0:1788201306.408267:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201306.408270:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408275:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472071c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408307:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee4472070e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc096 expref: 45 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408321:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc096 expref: 44 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.408328:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201306.408330:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201306.408332:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1600, rc 0) 00000100:00100000:2.0:1788201306.408370:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+44:11217:x1875064662301312:12345-192.168.203.2@tcp:101:stat.0 Request processed in 21957us (22295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.408377:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:0.0:1788201306.417175:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:2.0:1788201306.525032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201306.525152:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662301952 00000100:00100000:3.0:1788201306.525162:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662301952 00000100:00100000:3.0:1788201306.525253:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:3.0:1788201306.525264:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+43:11223:x1875064662301952:12345-192.168.203.2@tcp:36:truncate.0 00010000:00010000:3.0:1788201306.525335:0:10723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201306.525361:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720723 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc096 expref: 43 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.525379:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201306.525384:0:10723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201306.525559:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.525573:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.525595:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201306.525645:0:10723:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1788201306.525669:0:10723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e9350df reply state 000000001b9d0036 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.525692:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.525700:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201306.525702:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201306.525705:0:10723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201306.525873:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+45:11223:x1875064662301952:12345-192.168.203.2@tcp:36:truncate.0 Request processed in 610us (848us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788201306.525881:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000020:00080000:3.0:1788201306.525886:0:10723:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201306.693319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201306.693421:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662302080 00000100:00100000:2.0:1788201306.693440:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662302080 00000100:00100000:2.0:1788201306.693508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1788201306.693519:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+45:11237:x1875064662302080:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:2.0:1788201306.693544:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201306.693565:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720731 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc09d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.693645:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.693660:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.693670:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.693681:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.693687:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.693693:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694022:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694033:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694059:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201306.694108:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788201306.694113:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201306.694132:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694142:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694149:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694154:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694160:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694165:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201306.694168:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694174:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694185:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201306.694187:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201306.694191:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694205:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720738 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694217:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694221:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694226:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694230:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201306.694232:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694237:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694243:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:2.0:1788201306.694244:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201306.694247:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694252:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee4472073f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694275:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720731 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694286:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.694300:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201306.694303:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201306.694306:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0000, rc 0) 00000100:00100000:2.0:1788201306.694471:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+46:11237:x1875064662302080:12345-192.168.203.2@tcp:101:stat.0 Request processed in 953us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.694479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1788201306.792399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201306.792531:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662302336 00000100:00100000:0.0:1788201306.792545:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662302336 00000100:00100000:0.0:1788201306.792636:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:0.0:1788201306.792648:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+46:11247:x1875064662302336:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201306.792690:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201306.792719:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472074d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0a4 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201306.792941:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788201306.793090:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472074d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0a4 expref: 48 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.793108:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:0.0:1788201306.793111:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201306.793117:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472074d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0a4 expref: 48 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.793162:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d400, rc 0) 00000100:00100000:0.0:1788201306.793253:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+47:11247:x1875064662302336:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 606us (868us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788201306.793261:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:3.0:1788201306.798299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201306.798548:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662302592 00000100:00100000:2.0:1788201306.798561:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662302592 00000100:00100000:2.0:1788201306.798641:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:2.0:1788201306.798652:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+47:11247:x1875064662302592:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201306.799419:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+48:11247:x1875064662302592:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 763us (1130us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788201306.799429:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:1.0:1788201306.857886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201306.858115:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662302848 00000100:00100000:3.0:1788201306.858130:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662302848 00000100:00100000:3.0:1788201306.858208:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:3.0:1788201306.858221:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+48:11252:x1875064662302848:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201306.858257:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201306.858287:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472075b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0ab expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.858450:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.858469:0:10723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.858504:0:10723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.858553:0:10723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.858568:0:10723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 49 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201306.858599:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681266048:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201306.858831:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201306.863851:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681266048:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201306.864071:0:10723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201306.864247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201306.866551:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662302976 00000100:00100000:0.0:1788201306.866571:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662302976 00010000:00010000:0.0:1788201306.866824:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 50 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201306.867073:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:0.0:1788201306.867088:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+50:2399:x1875064662302976:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201306.867112:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201306.867121:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 50 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.867137:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 50 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.867171:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720746 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc09d expref: 50 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.867193:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:0.0:1788201306.867199:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.867211:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.867238:0:13184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.867273:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201306.867374:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+49:2399:x1875064662302976:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 289us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201306.867383:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00010000:00010000:3.0:1788201306.867924:0:10723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.867936:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201306.867969:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788201306.868158:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472075b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 50 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.868179:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 49 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201306.868205:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201306.868208:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201306.868211:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba600, rc 0) 00000100:00100000:3.0:1788201306.868268:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+49:11252:x1875064662302848:12345-192.168.203.2@tcp:101:bash.0 Request processed in 10050us (10397us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788201306.868277:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:1.0:1788201306.874973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201306.875051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662303232 00000100:00100000:2.0:1788201306.875065:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662303232 00000100:00100000:2.0:1788201306.875140:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:2.0:1788201306.875152:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+49:11252:x1875064662303232:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:2.0:1788201306.875459:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.875482:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.875497:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201306.875574:0:6516:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788201306.875599:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e49ff98f reply state 00000000f0ed5f44 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.875616:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.875624:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201306.875628:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201306.875632:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201306.876188:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+52:11252:x1875064662303232:12345-192.168.203.2@tcp:36:bash.0 Request processed in 1034us (1228us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788201306.876198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000020:00080000:2.0:1788201306.876204:0:6516:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201306.892184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201306.892294:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662303360 00000100:00100000:2.0:1788201306.892307:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662303360 00000100:00100000:2.0:1788201306.892386:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:2.0:1788201306.892398:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+52:11252:x1875064662303360:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201306.892435:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201306.892462:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720777 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.892631:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.892650:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 53 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.892672:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.892716:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 53 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.892732:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 53 pid: 10723 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201306.892795:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681266176:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201306.892916:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201306.895293:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681266176:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201306.895331:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201306.906114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201306.907966:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662303488 00000100:00100000:0.0:1788201306.907994:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662303488 00010000:00010000:1.0:1788201306.908113:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 54 pid: 10723 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201306.908175:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:1.0:1788201306.908186:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+54:2399:x1875064662303488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201306.908206:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201306.908214:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 54 pid: 10723 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.908229:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 54 pid: 10723 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.908263:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720762 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ab expref: 54 pid: 10723 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.908284:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:1.0:1788201306.908290:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.908302:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.908311:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.908368:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201306.908594:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.908604:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201306.908671:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788201306.908677:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201306.908707:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.908841:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720777 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0b2 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.908860:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0b2 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201306.908881:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00000100:00100000:1.0:1788201306.909414:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+53:2399:x1875064662303488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1226us (3312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201306.909425:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00010000:00010000:0.0:1788201306.909485:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201306.909491:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0e00, rc 0) 00000100:00100000:0.0:1788201306.909557:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+52:11252:x1875064662303360:12345-192.168.203.2@tcp:101:bash.0 Request processed in 17162us (17388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201306.909565:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:1.0:1788201306.912453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201306.912608:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662303744 00000100:00100000:0.0:1788201306.912622:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662303744 00000100:00100000:0.0:1788201306.912701:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:0.0:1788201306.912714:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf41c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+52:11252:x1875064662303744:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:0.0:1788201306.913149:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf41c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+53:11252:x1875064662303744:12345-192.168.203.2@tcp:35:bash.0 Request processed in 436us (708us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788201306.913158:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:1.0:1788201307.001122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.001921:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662304000 00000100:00100000:3.0:1788201307.001937:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662304000 00000100:00100000:3.0:1788201307.002060:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:3.0:1788201307.002075:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+53:11263:x1875064662304000:12345-192.168.203.2@tcp:101:lfs.0 00000100:00080000:0.0:1788201307.002081:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201307.002111:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201307.002140:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720785 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0b9 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201307.002490:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788201307.003004:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720785 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0b9 expref: 55 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.003023:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:3.0:1788201307.003027:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201307.003032:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44720785 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0b9 expref: 55 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.003050:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bac00, rc 0) 00000100:00100000:3.0:1788201307.003143:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+54:11263:x1875064662304000:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1072us (2035us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788201307.003173:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:3.0:1788201307.005700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201307.007206:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662304128 00000100:00100000:1.0:1788201307.007224:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662304128 00000100:00100000:1.0:1788201307.007354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:1.0:1788201307.007378:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+54:11263:x1875064662304128:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:1.0:1788201307.007486:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007518:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007534:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007550:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007559:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007566:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007660:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007671:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007679:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201307.007847:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007872:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007880:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007888:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007901:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201307.007906:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007914:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007930:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:1.0:1788201307.007934:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201307.007940:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007958:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720793 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007974:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.007981:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008002:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008008:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201307.008011:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008025:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008035:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:1.0:1788201307.008037:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201307.008041:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008047:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472079a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008066:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008073:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008079:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008084:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201307.008087:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008110:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008120:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:1.0:1788201307.008129:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201307.008132:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.008139:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447207a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201307.008266:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+54:11263:x1875064662304128:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 892us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201307.008278:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:1.0:1788201307.011451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.011617:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662304384 00000100:00100000:3.0:1788201307.011631:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662304384 00000100:00100000:3.0:1788201307.011711:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:3.0:1788201307.011724:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+54:11263:x1875064662304384:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1788201307.012057:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+55:11263:x1875064662304384:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 335us (618us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788201307.012067:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1788201307.061205:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201307.061477:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662304640 00000100:00100000:2.0:1788201307.061490:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662304640 00000100:00100000:2.0:1788201307.061620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:2.0:1788201307.061633:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+55:11266:x1875064662304640:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201307.061667:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201307.061692:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447207a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.061838:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.061856:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062006:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062044:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062053:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062061:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062283:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447207bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062294:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447207bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062302:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447207bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201307.062313:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788201307.062412:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062420:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062428:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062436:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201307.062441:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062461:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062475:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201307.062478:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201307.062484:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062490:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447207af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062507:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062513:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062519:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062525:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201307.062528:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062534:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062541:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:2.0:1788201307.062544:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201307.062546:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062561:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447207b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062608:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447207a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0c0 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062622:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447207bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0c0 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.062630:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201307.062632:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201307.062635:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0800, rc 0) 00000100:00100000:2.0:1788201307.062846:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+57:11266:x1875064662304640:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1214us (1655us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788201307.062854:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:1.0:1788201307.069550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201307.069634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201307.070125:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662304896 00000100:00100000:0.0:1788201307.070141:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662304896 00000100:00100000:0.0:1788201307.070231:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1788201307.070244:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+57:2400:x1875064662304896:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201307.070263:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201307.070293:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447207bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0c0 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.070317:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:0.0:1788201307.070323:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201307.070417:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+56:2400:x1875064662304896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 176us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201307.070425:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:3.0:1788201307.071464:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662304768 00000100:00100000:3.0:1788201307.071475:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662304768 00000100:00100000:3.0:1788201307.071534:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:3.0:1788201307.071543:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+56:11266:x1875064662304768:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:3.0:1788201307.071651:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.071670:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.071694:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.072046:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.072056:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.072075:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.072082:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bac00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201307.072087:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.072095:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.072107:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201307.072121:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201307.072127:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.072134:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201307.072218:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+56:11266:x1875064662304768:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 675us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.072227:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:1.0:1788201307.074234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.074388:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662305152 00000100:00100000:3.0:1788201307.074399:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662305152 00000100:00100000:3.0:1788201307.074463:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1788201307.074475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+56:11266:x1875064662305152:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1788201307.074797:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+57:11266:x1875064662305152:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 323us (574us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788201307.074805:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:1.0:1788201307.220218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.220359:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662305408 00000100:00100000:3.0:1788201307.220371:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662305408 00000100:00100000:3.0:1788201307.220465:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00100000:3.0:1788201307.220477:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+57:11284:x1875064662305408:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1788201307.220508:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201307.220534:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.220675:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447207d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.220692:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447207d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.220706:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447207d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201307.220718:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788201307.221182:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0c7 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.221208:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447207d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0c7 expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.221219:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201307.221222:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788201307.221226:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbc00, rc 0) 00000100:00100000:3.0:1788201307.221305:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11284:x1875064662305408:12345-192.168.203.2@tcp:101:cat.0 Request processed in 830us (1101us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788201307.221332:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00100000:2.0:1788201307.243296:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201307.243891:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662305536 00000100:00100000:0.0:1788201307.243904:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662305536 00000100:00100000:0.0:1788201307.243998:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:0.0:1788201307.244012:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11285:x1875064662305536:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201307.244045:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201307.244071:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447207e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.244160:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447207ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.244176:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447207ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.244191:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447207ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201307.244245:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788201307.244250:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201307.244273:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447207ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.244303:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447207e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ce expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.244327:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447207ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ce expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.244360:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:0.0:1788201307.244363:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201307.244367:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d200, rc 0) 00000100:00100000:0.0:1788201307.244456:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11285:x1875064662305536:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 446us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201307.244463:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:1.0:1788201307.253520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.253679:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662305920 00000100:00100000:3.0:1788201307.253692:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662305920 00000100:00100000:3.0:1788201307.253790:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1788201307.253804:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11285:x1875064662305920:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1788201307.254498:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11285:x1875064662305920:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 690us (987us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788201307.254507:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1788201307.260913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201307.261084:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662306048 00000100:00100000:0.0:1788201307.261095:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662306048 00000100:00100000:0.0:1788201307.261177:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:0.0:1788201307.261190:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11285:x1875064662306048:12345-192.168.203.2@tcp:103:lfs.0 00010000:00010000:0.0:1788201307.261210:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201307.261242:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472077e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0b2 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.261270:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447207d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0c7 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.261283:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472067b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc06c expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201307.261293:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:0.0:1788201307.261299:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201307.261375:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+58:11285:x1875064662306048:12345-192.168.203.2@tcp:103:lfs.0 Request processed in 188us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201307.261384:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1788201307.263348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.263469:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662306176 00000100:00100000:3.0:1788201307.263479:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662306176 00000100:00100000:3.0:1788201307.263833:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:3.0:1788201307.263846:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+58:11285:x1875064662306176:12345-192.168.203.2@tcp:58:lfs.0 00010000:00010000:3.0:1788201307.264004:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.264025:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.264038:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201307.267045:0:10723:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201307.267268:0:10723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788201307.267373:0:10723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788201307.267619:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+58:11285:x1875064662306176:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 3767us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.267634:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:1.0:1788201307.290284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.290390:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662306304 00000100:00100000:3.0:1788201307.290403:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662306304 00000100:00100000:3.0:1788201307.290537:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:3.0:1788201307.290550:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+58:11287:x1875064662306304:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201307.290578:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201307.290604:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447207fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290692:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290711:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290724:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290779:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290788:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290796:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290893:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290904:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.290933:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201307.291001:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788201307.291006:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201307.291028:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291042:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291050:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291056:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291063:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291070:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bae00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201307.291074:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291082:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291097:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201307.291101:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201307.291106:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291123:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720803 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291140:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291147:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291152:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291157:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201307.291160:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291165:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291172:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:3.0:1788201307.291174:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201307.291177:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291183:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472080a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291217:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447207fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291232:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.291246:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201307.291249:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201307.291252:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba200, rc 0) 00000100:00100000:3.0:1788201307.291401:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11287:x1875064662306304:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 853us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.291409:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 77 00010000:00010000:1.0:1788201307.318117:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201307.765952:0:9981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388063209533ns, next at 389063197033ns, rc = 0 00000100:00100000:1.0:1788201307.766178:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681266304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201307.766273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201307.766413:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681266304 00000100:00100000:2.0:1788201307.766423:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681266304 00000100:00100000:2.0:1788201307.766537:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788201307.766550:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681266304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201307.766588:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788201307.766644:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681266304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201307.766652:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788201307.770080:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681266560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.770198:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201307.770283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681266560 00000100:00100000:2.0:1788201307.770294:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681266560 00000100:00100000:2.0:1788201307.770357:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788201307.770369:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681266560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.770437:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681266560:12345-0@lo:400:kworker.0 Request processed in 70us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201307.770445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788201307.770501:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681266560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.770542:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201307.770549:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681266688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.770579:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201307.770636:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681267072:0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.770662:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201307.770705:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201307.770711:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681267200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.770735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201307.770791:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681267072 00000100:00100000:2.0:1788201307.770795:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681267072 00000100:00100000:3.0:1788201307.770872:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681266688 00000100:00100000:3.0:1788201307.770877:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681266688 00000100:00100000:3.0:1788201307.770916:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201307.770924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681266688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.770986:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681266688:12345-0@lo:400:kworker.0 Request processed in 63us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.770992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201307.771014:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681267200 00000100:00100000:3.0:1788201307.771017:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681267200 00000100:00080000:1.0:1788201307.771076:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201307.771082:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201307.771086:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201307.771103:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681266816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201307.771158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201307.771210:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681266304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201307.771229:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201307.771235:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681266432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201307.771285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201307.771310:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681266944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201307.771334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201307.771364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681266432 00000100:00100000:1.0:1788201307.771369:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681266432 00000100:00100000:1.0:1788201307.771399:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788201307.771406:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681266432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201307.771441:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681266432:12345-0@lo:400:kworker.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201307.771447:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788201307.771487:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681266432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.773687:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681266816 00000100:00100000:2.0:1788201307.773703:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681266816 00000100:00100000:2.0:1788201307.773734:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788201307.773761:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681267072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.773874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681267072:12345-0@lo:400:kworker.0 Request processed in 116us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201307.773891:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788201307.773910:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788201307.773916:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681266816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201307.773968:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681266816:12345-0@lo:400:kworker.0 Request processed in 51us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201307.773974:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788201307.774365:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681267712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.774416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201307.774449:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201307.774455:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681267584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.774478:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201307.774506:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681266944 00000100:00100000:3.0:1788201307.774512:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681266944 00000100:00100000:3.0:1788201307.774546:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788201307.774553:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681266944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.774593:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681266944:12345-0@lo:400:kworker.0 Request processed in 41us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.774609:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788201307.774633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681267712 00000100:00100000:3.0:1788201307.774637:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681267712 00000100:00100000:3.0:1788201307.774661:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681267584 00000100:00100000:3.0:1788201307.774664:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681267584 00000100:00100000:3.0:1788201307.774681:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788201307.774687:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681267712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.774721:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681267712:12345-0@lo:400:kworker.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.774727:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788201307.774757:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788201307.774764:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681267584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.774790:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681267584:12345-0@lo:400:kworker.0 Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.774795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788201307.774819:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681267456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.774847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201307.774867:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201307.774872:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681267328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.774891:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201307.774912:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681267840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.774930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201307.774968:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681267456 00000100:00100000:3.0:1788201307.774972:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681267456 00000100:00100000:3.0:1788201307.775000:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681267328 00000100:00100000:3.0:1788201307.775003:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681267328 00000100:00100000:3.0:1788201307.775029:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681267840 00000100:00100000:3.0:1788201307.775033:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681267840 00000100:00100000:3.0:1788201307.775050:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788201307.775055:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681267456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775093:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681267456:12345-0@lo:400:kworker.0 Request processed in 37us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.775098:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788201307.775111:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788201307.775116:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681267328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775140:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681267328:12345-0@lo:400:kworker.0 Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.775146:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788201307.775158:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201307.775163:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681267840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775187:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681267840:12345-0@lo:400:kworker.0 Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.775192:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201307.775240:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681267328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775254:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681267840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775263:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681267456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775297:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681267584:0@lo:400:kworker.0 00010000:00080000:3.0:1788201307.775311:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf837a7800 x1875064681267712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201307.775322:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681267712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775368:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681267072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775380:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681266688:0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775421:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788201307.775428:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681267200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201307.775466:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681267200:12345-0@lo:400:kworker.0 Request processed in 39us (4730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.775472:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00080000:3.0:1788201307.775500:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf837a6680 x1875064681267200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201307.775510:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681267200:0@lo:400:kworker.0 00000100:00080000:1.0:1788201307.778654:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201307.778666:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201307.778670:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201307.778673:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201307.778733:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681266944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201307.778774:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681266816:0@lo:400:kworker.0 00000040:00080000:2.0:1788201307.894255:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201307.894268:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201307.894317:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788201307.894329:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201307.894504:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681267968:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201307.894722:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201307.899492:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681267968:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201307.901678:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.901840:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662306432 00000100:00100000:3.0:1788201307.901853:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662306432 00000100:00100000:3.0:1788201307.902089:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:3.0:1788201307.902102:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11299:x1875064662306432:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788201307.902148:0:6515:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788201307.902651:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11299:x1875064662306432:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 547us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.902661:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:1.0:1788201307.918815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201307.918886:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662306560 00000100:00100000:2.0:1788201307.918898:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662306560 00000100:00100000:2.0:1788201307.918981:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:2.0:1788201307.918994:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11299:x1875064662306560:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788201307.919100:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919120:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919137:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919337:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919362:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919375:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919420:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919431:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919438:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201307.919494:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788201307.919500:0:8476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201307.919518:0:8476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919532:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919540:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919547:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919570:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201307.919575:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919582:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919595:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:2.0:1788201307.919598:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201307.919603:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919609:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720818 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919624:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919629:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919634:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919639:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201307.919641:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919647:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919667:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9ce0839b3500) 00010000:00010000:2.0:1788201307.919670:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201307.919673:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919679:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee4472081f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919696:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919702:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919709:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919715:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201307.919718:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919781:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919790:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201307.919793:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201307.919796:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201307.919802:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720826 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201307.919911:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11299:x1875064662306560:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 915us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201307.919926:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:1.0:1788201307.925145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.925283:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662306816 00000100:00100000:3.0:1788201307.925294:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662306816 00000100:00100000:3.0:1788201307.925368:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:3.0:1788201307.925381:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11299:x1875064662306816:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201307.925411:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201307.925453:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472082d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0dc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.925622:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.925639:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.925652:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201307.925664:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788201307.926207:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926220:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926227:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926234:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201307.926239:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926247:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926263:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201307.926266:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201307.926271:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926289:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720834 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926344:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472082d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0dc expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926355:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:3.0:1788201307.926357:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201307.926361:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472082d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0dc expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.926369:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201307.926451:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11299:x1875064662306816:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1072us (1321us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788201307.926459:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:3.0:1788201307.931130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.931183:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662306944 00000100:00100000:3.0:1788201307.931195:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662306944 00000100:00100000:3.0:1788201307.931254:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:3.0:1788201307.931264:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11299:x1875064662306944:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788201307.931311:0:6515:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788201307.931485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11299:x1875064662306944:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 221us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.931493:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:1.0:1788201307.939948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.940073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662307200 00000100:00100000:3.0:1788201307.940089:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662307200 00000100:00100000:3.0:1788201307.940194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:3.0:1788201307.940206:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11299:x1875064662307200:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201307.940236:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201307.940240:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201307.940277:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447207ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ce expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.940303:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201307.940309:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201307.940327:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720842 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0e3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201307.941342:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788201307.943381:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720849 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.943412:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720849 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.944218:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720849 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.944349:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720842 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0e3 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.944372:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720849 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0e3 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.944382:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939b00) 00010000:00010000:3.0:1788201307.944401:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201307.944406:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb600, rc 0) 00000100:00100000:3.0:1788201307.945875:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11299:x1875064662307200:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 5656us (5934us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788201307.945890:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:1.0:1788201307.954102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.954387:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662307456 00000100:00100000:3.0:1788201307.954405:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662307456 00000100:00100000:1.0:1788201307.955532:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:1.0:1788201307.955550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11299:x1875064662307456:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201307.955625:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201307.955661:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720849 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0e3 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.955685:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939b00) 00010000:00010000:1.0:1788201307.955698:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201307.955769:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.955787:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.955797:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.956849:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.956870:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.956882:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957433:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957443:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957470:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957477:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201307.957482:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957489:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957502:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:1.0:1788201307.957505:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201307.957509:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957515:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720857 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957530:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957537:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957542:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957547:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201307.957550:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957567:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957576:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb2364316 (ffff9ce0866ccb00) 00010000:00010000:1.0:1788201307.957578:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201307.957581:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.957587:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472085e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb2364316 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201307.959510:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11299:x1875064662307456:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 3954us (5407us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201307.959523:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:1.0:1788201307.977792:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201307.984834:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662307584 00000100:00100000:3.0:1788201307.984852:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662307584 00000100:00100000:3.0:1788201307.984974:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00100000:3.0:1788201307.984986:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11299:x1875064662307584:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201307.985009:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201307.985031:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720865 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0ea expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.985091:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.985108:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.985121:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.985241:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720865 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 62 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.985260:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 61 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201307.985281:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:3.0:1788201307.985284:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201307.985288:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb200, rc 0) 00000100:00100000:3.0:1788201307.985537:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11299:x1875064662307584:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 552us (7753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201307.985546:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00100000:3.0:1788201307.993921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201307.994019:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662307840 00000100:00100000:1.0:1788201307.994038:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662307840 00000100:00100000:1.0:1788201307.994125:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 85 00000100:00100000:1.0:1788201307.994137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11299:x1875064662307840:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201307.994249:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.994270:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.994284:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201307.994504:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788201307.994530:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 388291791161ns, next at 389291788936ns, rc = 0 00000004:00010000:1.0:1788201307.994605:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b53c8b74 reply state 00000000b7231d02 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.994618:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201307.994626:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:1.0:1788201307.994629:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788201307.994633:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201307.996278:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+63:11299:x1875064662307840:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 2128us (2351us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788201307.996292:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 85 00000100:00100000:1.0:1788201308.008611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201308.008676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662307968 00000100:00100000:2.0:1788201308.008699:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662307968 00000100:00100000:3.0:1788201308.008997:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 86 00000100:00100000:3.0:1788201308.009020:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+63:11299:x1875064662307968:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201308.009055:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201308.009085:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0f1 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.009161:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 64 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.009179:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 64 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.009203:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:3.0:1788201308.009207:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201308.009211:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bae00, rc 0) 00000100:00100000:3.0:1788201308.009293:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+64:11299:x1875064662307968:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 282us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.009301:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 86 00000100:00100000:3.0:1788201308.013968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.014552:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662308096 00000100:00100000:1.0:1788201308.014566:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662308096 00000100:00100000:1.0:1788201308.014640:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:1.0:1788201308.014652:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875064662308096:12345-192.168.203.2@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788201308.014693:0:8432:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:1.0:1788201308.014775:0:8432:0:(genops.c:1406:class_connect()) connect: client da566c69-17bd-4938-bc1e-8b9ba2633293, cookie 0xf9b71aee44720881 00002000:00100000:1.0:1788201308.014791:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da566c69-17bd-4938-bc1e-8b9ba2633293/ffff9ce09005f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201308.014818:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000001:00080000:2.0:1788201308.014868:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:2.0:1788201308.014881:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1788201308.014913:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00002000:00080000:1.0:1788201308.014924:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201308.014976:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ce09005c800 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1788201308.014995:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788201308.015009:0:6495:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce0ba3910c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788201308.015014:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0b6c32700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce0ba391c00 00000020:00080000:2.0:1788201308.015018:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0b6c32000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cdf8350a000 00010000:00010000:2.0:1788201308.015075:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.015075:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2397:x1875064662308096:12345-192.168.203.2@tcp:8:lhsmtool_posix.0 Request processed in 423us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.015101:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00010000:00010000:2.0:1788201308.015103:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015115:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015125:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ce00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201308.015130:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015139:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015155:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ce0b25e5300) 00010000:00010000:2.0:1788201308.015167:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201308.015173:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015179:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447205b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015202:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015209:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015216:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015221:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201308.015224:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015231:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015241:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201308.015245:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201308.015249:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015256:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee447205be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015278:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015311:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015317:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015323:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201308.015327:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015333:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015342:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc000) 00010000:00010000:2.0:1788201308.015345:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201308.015347:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015354:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447205fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015371:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015378:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015384:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015389:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201308.015398:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015404:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015413:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201308.015416:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201308.015418:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015424:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720707 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015434:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015442:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015449:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015456:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201308.015459:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015466:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015475:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00000100:00100000:1.0:1788201308.015475:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681268096:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201308.015489:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201308.015498:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015505:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472072a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015520:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015527:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015534:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015541:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc1b2a4f0) 00000100:00100000:1.0:1788201308.015549:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201308.015550:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015560:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015571:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:2.0:1788201308.015573:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201308.015576:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015582:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720770 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015592:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015599:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015612:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201308.015614:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681268096 00010000:00010000:2.0:1788201308.015621:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201308.015625:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201308.015625:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681268096 00010000:00010000:2.0:1788201308.015634:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015643:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:2.0:1788201308.015646:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201308.015649:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.015655:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720873 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788201308.015721:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1788201308.015904:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201308.015916:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681268096:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788201308.015933:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00002000:00080000:0.0:1788201308.015955:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788201308.015994:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a95c958, atime: 0x6a95c958, ctime: 0x6a95c958, blocks: 0x8 00010000:00010000:0.0:1788201308.016002:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.016017:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1788201308.016022:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201308.016030:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.016452:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.016463:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.016470:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.016500:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201308.016658:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681268096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 745us (1114us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788201308.016666:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788201308.016984:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201308.016992:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.017002:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201308.017007:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.017016:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.017046:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.017056:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d48e645/0xf9b71aee44720888 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201308.017067:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681268224:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788201308.017078:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201308.017081:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201308.017083:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201308.017114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201308.017122:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ce0bf6a9f80/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788201308.017130:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681268096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201308.017607:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681268224 00000100:00100000:0.0:1788201308.017615:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681268224 00000100:00100000:0.0:1788201308.017649:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201308.017659:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681268224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788201308.017832:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681268224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (717us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788201308.017841:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:3.0:1788201308.017989:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf837a7480/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788201308.018004:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681268224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788201308.018497:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.018559:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662308224 00000100:00100000:1.0:1788201308.018566:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662308224 00000100:00100000:1.0:1788201308.018621:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:1.0:1788201308.018640:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:0:x1875064662308224:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788201308.018805:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788201308.031413:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788201308.031427:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1788201308.031433:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000100:00100000:1.0:1788201308.031813:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:0:x1875064662308224:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 13167us (13311us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788201308.031825:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:2.0:1788201308.037985:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.038069:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662308480 00000100:00100000:3.0:1788201308.038085:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662308480 00000100:00100000:3.0:1788201308.038169:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:3.0:1788201308.038187:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+13:11299:x1875064662308480:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788201308.038499:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+14:11299:x1875064662308480:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 318us (521us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788201308.038508:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:3.0:1788201308.043040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201308.044066:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662308736 00000100:00100000:0.0:1788201308.044081:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662308736 00000100:00100000:0.0:1788201308.044146:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 87 00000100:00100000:0.0:1788201308.044157:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+14:11299:x1875064662308736:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788201308.044285:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+14:11299:x1875064662308736:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 130us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.044294:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 87 00000100:00100000:3.0:1788201308.046475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201308.049534:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662308864 00000100:00100000:0.0:1788201308.049549:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662308864 00000100:00100000:0.0:1788201308.049630:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 88 00000100:00100000:0.0:1788201308.049642:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+14:11299:x1875064662308864:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201308.049661:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201308.049682:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472088f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0f8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.049778:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720896 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.049793:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720896 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.049819:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720896 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201308.049870:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201308.049891:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720896 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.049918:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472088f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f8 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.049954:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720896 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f8 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.049963:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:0.0:1788201308.049966:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788201308.049969:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367cc00, rc 0) 00000100:00100000:0.0:1788201308.050048:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11299:x1875064662308864:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 407us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.050056:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 88 00000100:00100000:2.0:1788201308.054958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.055032:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662308992 00000100:00100000:3.0:1788201308.055050:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662308992 00000100:00100000:3.0:1788201308.055132:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:3.0:1788201308.055154:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662308992:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201308.055180:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201308.055209:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc0ff expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201308.055241:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c95b, blocks: 0x0 00010000:00010000:3.0:1788201308.055267:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1788201308.055273:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201308.055286:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.055330:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.055356:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201308.055442:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662308992:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 295us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.055453:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:0.0:1788201308.070587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.071664:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662309248 00000100:00100000:1.0:1788201308.071678:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662309248 00000100:00100000:0.0:1788201308.072477:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 89 00000100:00100000:0.0:1788201308.072493:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11299:x1875064662309248:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788201308.072853:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11299:x1875064662309248:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 362us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.072862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 89 00000100:00100000:2.0:1788201308.087078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.087230:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662309376 00000100:00100000:3.0:1788201308.087243:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662309376 00000100:00100000:3.0:1788201308.087321:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:3.0:1788201308.087334:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:11299:x1875064662309376:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201308.087360:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201308.087387:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc106 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.087447:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.087457:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201308.087462:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201308.087468:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.087512:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.087537:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 7 pid: 8430 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201308.087555:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875064681268352:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201308.087690:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201308.091005:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.091055:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662309504 00000100:00100000:3.0:1788201308.091066:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662309504 00010000:00010000:3.0:1788201308.091117:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 8 pid: 8430 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201308.091165:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:3.0:1788201308.091176:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662309504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201308.091196:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201308.091227:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 8 pid: 8430 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.091245:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 8 pid: 8430 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.091279:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201308.091285:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201308.091296:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.091322:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.091368:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201308.091386:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6502:1875064681268480:192.168.203.2@tcp:105: 00000100:00100000:3.0:1788201308.091482:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340ac00 going to sleep for 11 seconds 00010000:00010000:2.0:1788201308.091801:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee4472089d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ff expref: 8 pid: 8430 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201308.091834:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf550a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875064681268352:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201308.091868:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.091881:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb800, rc 0) 00000100:00100000:2.0:1788201308.091942:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:11299:x1875064662309376:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 4603us (4872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201308.091952:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:0.0:1788201308.107269:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6502:1875064681268480:192.168.203.2@tcp:105: 00010000:00010000:0.0:1788201308.107324:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201308.109995:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662309504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 18805us (18991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.110011:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:3.0:1788201308.115068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201308.123258:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662309632 00000100:00100000:2.0:1788201308.123274:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662309632 00002000:00100000:2.0:1788201308.123331:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9cdf836cb480 x1875064662309632/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:429/0 lens 504/0 e 0 to 0 dl 1788201319 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201308.123345:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf836cb480 with x1875064662309632 ext(0->8) 00002000:00010000:2.0:1788201308.123350:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf836cb480 00000100:00100000:2.0:1788201308.123394:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1788201308.123407:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662309632:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788201308.126098:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662309632:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 Request processed in 2679us (11030us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788201308.126119:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00002000:00100000:3.0:1788201308.126133:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9cdf836cb480 x1875064662309632/t4294967304(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:429/0 lens 504/448 e 0 to 0 dl 1788201319 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201308.126143:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf836cb480 with x1875064662309632 ext(0->8) 00002000:00010000:3.0:1788201308.126150:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf836cb480 00000100:00100000:3.0:1788201308.140184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.142566:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662309760 00000100:00100000:1.0:1788201308.142586:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662309760 00000100:00100000:1.0:1788201308.142684:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 90 00000100:00100000:1.0:1788201308.142698:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11299:x1875064662309760:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788201308.142902:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11299:x1875064662309760:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 207us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.142911:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 90 00000100:00100000:2.0:1788201308.145929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201308.147987:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662309888 00000100:00100000:0.0:1788201308.148005:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662309888 00000100:00100000:0.0:1788201308.148088:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:0.0:1788201308.148100:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662309888:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788201308.151508:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1788201308.151671:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662309888:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 3565us (5757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.151694:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:2.0:1788201308.159005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.159325:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662310144 00000100:00100000:1.0:1788201308.159339:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662310144 00000100:00100000:0.0:1788201308.159581:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:0.0:1788201308.159596:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11299:x1875064662310144:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788201308.159673:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201308.159707:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720896 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f8 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.159731:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:0.0:1788201308.159762:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201308.159806:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.159823:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.159834:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201308.160015:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000197aaeab reply state 00000000e613d19e transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.160028:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.160035:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:0.0:1788201308.160037:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201308.160040:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201308.160168:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+16:11299:x1875064662310144:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 576us (1179us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1788201308.160176:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:3.0:1788201308.166839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.166946:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662310272 00000100:00100000:1.0:1788201308.166959:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662310272 00000100:00100000:1.0:1788201308.167030:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:1.0:1788201308.167042:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662310272:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788201308.167255:0:8485:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788201308.167259:0:8485:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788201306 00002000:00010000:1.0:1788201308.167261:0:8485:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788201304 00002000:00010000:1.0:1788201308.167263:0:8485:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788201307 -> 1788201306 00002000:00010000:1.0:1788201308.167266:0:8485:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788201308.167370:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662310272:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 320us (535us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788201308.167398:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000040:00080000:2.0:1788201308.181228:0:14206:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201308.181242:0:14206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201308.181270:0:14206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788201308.181278:0:14206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201308.185767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201308.185911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662310528 00000100:00100000:2.0:1788201308.185931:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662310528 00000100:00100000:2.0:1788201308.186008:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00100000:2.0:1788201308.186021:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+16:11299:x1875064662310528:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788201308.186116:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.186136:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 16 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.186148:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.186197:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 16 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201308.186215:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 16 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201308.186233:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681268608:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201308.187609:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201308.192163:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201308.192278:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681268608:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201308.192323:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201308.192906:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662310656 00000100:00100000:0.0:1788201308.192915:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662310656 00010000:00010000:0.0:1788201308.192971:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 17 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201308.193012:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1788201308.193024:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+17:2399:x1875064662310656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201308.193043:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201308.193052:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 17 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.193083:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 17 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.193111:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472086c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0ea expref: 17 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.193127:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:0.0:1788201308.193133:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.193143:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.193152:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.193176:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201308.193882:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+16:2399:x1875064662310656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 856us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.193892:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00010000:00010000:0.0:1788201308.193931:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.193949:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.193998:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.194020:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.194028:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.194035:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201308.194040:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.194048:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.194061:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:0.0:1788201308.194065:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788201308.194069:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201308.194076:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee447208b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201308.198204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11299:x1875064662310528:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 Request processed in 12169us (12457us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788201308.198224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00100000:1.0:1788201308.204435:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.204537:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662310784 00000100:00100000:3.0:1788201308.204549:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662310784 00000100:00100000:3.0:1788201308.204777:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:3.0:1788201308.204791:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662310784:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788201308.204892:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.204926:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.204946:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201308.204952:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201308.204957:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.205000:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.205016:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 7 pid: 8431 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201308.205034:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875064681268736:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201308.205140:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201308.214362:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875064681268736:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201308.214405:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201308.222431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.225898:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662310912 00000100:00100000:3.0:1788201308.225918:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662310912 00010000:00010000:3.0:1788201308.225987:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 8 pid: 8431 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201308.226058:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:3.0:1788201308.226070:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662310912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201308.226091:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201308.226116:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 8 pid: 8431 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.226133:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 8 pid: 8431 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.226163:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab98fd63/0xf9b71aee447208a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc106 expref: 8 pid: 8431 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.226180:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201308.226185:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201308.226192:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.226204:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.226240:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201308.226323:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662310912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 254us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.226332:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00010000:00010000:3.0:1788201308.229477:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.229502:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.229542:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.229552:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.229562:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.229571:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201308.229577:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.229589:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.229614:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.229624:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000397c982b/0xf9b71aee447208b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.233668:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662310784:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 28861us (29291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.233786:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:0.0:1788201308.248023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.248124:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662311168 00000100:00100000:1.0:1788201308.248137:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662311168 00000100:00100000:1.0:1788201308.248216:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 93 00000100:00100000:1.0:1788201308.248229:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+15:11299:x1875064662311168:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788201308.248339:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.248361:0:10723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.248373:0:10723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.248421:0:10723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.248437:0:10723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 15 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.248455:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8372c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681268864:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201308.248575:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201308.257206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.257254:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662311296 00000100:00100000:1.0:1788201308.257265:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662311296 00010000:00010000:1.0:1788201308.257317:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 16 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.257361:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:1.0:1788201308.257373:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+16:2398:x1875064662311296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201308.257393:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201308.257401:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 16 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.257416:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 16 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.257443:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:1.0:1788201308.257450:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.257462:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.257471:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.257495:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201308.257559:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+16:2398:x1875064662311296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 188us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.257568:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00010000:00010000:1.0:1788201308.257676:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720700 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc08f expref: 15 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.257693:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8372c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681268864:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201308.257716:0:10723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.257759:0:10723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.257768:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.257992:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.258005:0:10723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 15 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.258014:0:10723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.258048:0:10723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 15 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.258064:0:10723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 15 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.258080:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8372c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681268992:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201308.258142:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201308.267332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.267422:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662311424 00000100:00100000:1.0:1788201308.267436:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662311424 00010000:00010000:1.0:1788201308.267492:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 16 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.267546:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:1.0:1788201308.267559:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+16:2399:x1875064662311424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201308.267579:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201308.267587:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 16 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.267603:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 16 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.267634:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:1.0:1788201308.267641:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.267653:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.267662:0:13184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.267815:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201308.267886:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+16:2399:x1875064662311424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 328us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.267894:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00010000:00010000:0.0:1788201308.273329:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee4472087a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0f1 expref: 15 pid: 8476 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201308.273361:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8372c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681268992:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201308.273423:0:10723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.273860:0:10723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.273868:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201308.274025:0:10723:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788201308.274165:0:10723:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788201308.274207:0:10723:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788201308.274311:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10723:1875064681269120:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201308.274399:0:10723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201308.274441:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201308.274471:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681269120 00000100:00100000:3.0:1788201308.274479:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681269120 00000100:00100000:3.0:1788201308.274537:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788201308.274547:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10723:x1875064681269120:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201308.274640:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10723:x1875064681269120:12345-0@lo:1000:mdt00_004.0 Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.274648:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788201308.274703:0:10723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1788201308.274709:0:10723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf837a7480, transno 4294967302 00000100:00100000:3.0:1788201308.274725:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10723:1875064681269120:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788201308.274886:0:10723:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788201308.274927:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10723:1875064681269248:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201308.274966:0:10723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201308.274983:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201308.275083:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681269248 00000100:00100000:3.0:1788201308.275087:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681269248 00000100:00100000:3.0:1788201308.275115:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201308.275122:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10723:x1875064681269248:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201308.275217:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10723:x1875064681269248:12345-0@lo:1000:mdt00_004.0 Request processed in 95us (249us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788201308.275225:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201308.275259:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10723:1875064681269248:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788201308.275293:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275302:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275310:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275317:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201308.275323:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275331:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275350:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:3.0:1788201308.275354:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201308.275359:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275366:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208c7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275410:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275417:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275423:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275428:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bac00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201308.275431:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275438:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275447:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:3.0:1788201308.275449:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201308.275452:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275458:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447207f5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275508:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275526:0:10723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275535:0:10723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275571:0:10723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.275587:0:10723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 18 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201308.275600:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681269376:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201308.275674:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba391d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201308.281252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201308.281892:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662311552 00000100:00100000:1.0:1788201308.281917:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662311552 00010000:00010000:1.0:1788201308.281981:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 19 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.282029:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:1.0:1788201308.282041:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+19:2399:x1875064662311552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201308.282065:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201308.282074:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 19 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.282091:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 19 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.282123:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:1.0:1788201308.282130:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.282143:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.282153:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.282178:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201308.282244:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+19:2399:x1875064662311552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 205us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.282253:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:2.0:1788201308.283891:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201308.283919:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681269504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201308.284011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201308.284069:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681269504 00000100:00100000:2.0:1788201308.284077:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681269504 00000100:00100000:2.0:1788201308.284141:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788201308.284151:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681269504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201308.284181:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788201308.284234:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681269504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201308.284242:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788201308.284302:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681269504:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201308.286972:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720811 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc0d5 expref: 18 pid: 6515 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201308.287000:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681269376:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201308.287031:0:10723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.290981:0:10723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291018:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291037:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291044:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291053:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291061:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201308.291067:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291076:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291100:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:1.0:1788201308.291104:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201308.291110:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291117:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447208ce lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291130:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291137:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291150:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291156:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201308.291159:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291165:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291173:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0839b3c00) 00010000:00010000:1.0:1788201308.291176:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201308.291179:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201308.291184:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447208c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201308.291477:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+17:11299:x1875064662311168:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 43242us (43461us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788201308.291491:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 93 00000020:00080000:1.0:1788201308.291499:0:10723:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788201308.296005:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201308.296021:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201308.296051:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788201308.296060:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201308.296906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.297922:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662311808 00000100:00100000:3.0:1788201308.297949:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662311808 00000100:00100000:3.0:1788201308.298031:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:3.0:1788201308.298046:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+17:11299:x1875064662311808:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788201308.298402:0:6519:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788201308.298447:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788201308.298490:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.298510:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.298524:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.298535:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.298543:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.298562:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.298589:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201308.298712:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+19:11299:x1875064662311808:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 669us (1813us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788201308.298721:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000020:00080000:3.0:1788201308.298727:0:6519:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788201308.300517:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201308.300529:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.300543:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201308.300548:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.300558:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.300577:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:3.0:1788201308.300581:0:7466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201308.300588:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.300595:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201308.300611:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201308.300612:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201308.300615:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201308.343157:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201308.354448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.354488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.354514:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.354531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.354555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201308.354587:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662312192 00000100:00100000:3.0:1788201308.354598:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662312192 00000100:00100000:3.0:1788201308.354662:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:3.0:1788201308.354674:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662312192:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201308.354779:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662312192:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 107us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.354787:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:3.0:1788201308.354811:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662312448 00000100:00100000:3.0:1788201308.354814:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662312448 00000100:00100000:3.0:1788201308.354839:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662312064 00000100:00100000:3.0:1788201308.354842:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662312064 00000100:00100000:3.0:1788201308.354860:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662312320 00000100:00100000:3.0:1788201308.354862:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662312320 00000100:00100000:3.0:1788201308.354882:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 279 00000100:00100000:3.0:1788201308.354889:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662312448:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201308.354920:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662312448:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.354926:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 279 00000100:00100000:3.0:1788201308.354953:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 280 00000100:00100000:3.0:1788201308.354959:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662312064:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201308.354984:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662312064:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.355004:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 280 00000100:00100000:3.0:1788201308.355018:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 281 00000100:00100000:3.0:1788201308.355025:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662312320:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201308.355051:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662312320:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.355057:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 281 00000100:00080000:3.0:1788201308.355080:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201308.355085:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201308.355087:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201308.360792:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662311936 00000100:00100000:2.0:1788201308.360814:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662311936 00000100:00100000:2.0:1788201308.360962:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 379 00000100:00100000:2.0:1788201308.360977:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662311936:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201308.361090:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662311936:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 117us (6654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201308.361099:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 379 00000040:00080000:2.0:1788201308.982718:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788201309.366000:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201309.814504:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201309.814534:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681269632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201309.814625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201309.814706:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681269632 00000100:00100000:2.0:1788201309.814714:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681269632 00000100:00100000:2.0:1788201309.814934:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788201309.814946:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681269632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201309.815001:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201309.817025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681269632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2065us (2384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201309.817044:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201309.817579:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201309.817604:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681269760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201309.817681:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201309.817839:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681269760 00000100:00100000:2.0:1788201309.817849:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681269760 00000100:00100000:2.0:1788201309.817900:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788201309.817911:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681269760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201309.817968:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788201309.818025:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681269760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201309.818033:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788201309.818083:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681269760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201309.819500:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681269632:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788201310.090404:0:14257:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201310.090416:0:14257:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201310.090445:0:14257:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788201310.090454:0:14257:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201310.189249:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.189819:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662312704 00000100:00100000:3.0:1788201310.189833:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662312704 00000100:00080000:1.0:1788201310.189894:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201310.189917:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 94 00000100:00100000:3.0:1788201310.189939:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+19:11317:x1875064662312704:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201310.189972:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201310.190119:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc10d expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.190269:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447208e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.190287:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447208e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.190303:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447208e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201310.190316:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788201310.190449:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447208dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc10d expref: 22 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.190478:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447208e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc10d expref: 21 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.190489:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201310.190493:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201310.190497:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bac00, rc 0) 00000100:00100000:3.0:1788201310.190581:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11317:x1875064662312704:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 645us (1343us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788201310.190589:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 94 00000100:00100000:3.0:1788201310.196140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201310.196340:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662312832 00000100:00100000:1.0:1788201310.196364:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662312832 00000100:00100000:1.0:1788201310.196441:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 95 00000100:00100000:1.0:1788201310.196453:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11317:x1875064662312832:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:1.0:1788201310.196569:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196591:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196606:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196627:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196634:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196641:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196776:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196786:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196793:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201310.196864:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196888:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196895:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196903:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196909:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201310.196915:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196933:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196949:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:1.0:1788201310.196952:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201310.196958:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196964:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447208f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196978:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196984:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.196990:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197001:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201310.197004:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197009:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197017:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866ccb00) 00010000:00010000:1.0:1788201310.197020:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201310.197023:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197028:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447208f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197043:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197049:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197054:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197060:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201310.197063:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197069:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197097:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ce0866cc800) 00010000:00010000:1.0:1788201310.197100:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201310.197103:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.197108:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447208ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201310.197213:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11317:x1875064662312832:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 760us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201310.197220:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 95 00000100:00100000:1.0:1788201310.245252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.245387:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662313088 00000100:00100000:3.0:1788201310.245408:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662313088 00000100:00100000:3.0:1788201310.245483:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 96 00000100:00100000:3.0:1788201310.245496:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11320:x1875064662313088:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201310.245527:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201310.245552:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720906 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc114 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.245849:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.245871:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.245886:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.245928:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.245938:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.245946:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246088:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246097:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246105:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201310.246116:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788201310.246211:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246221:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246228:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246236:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.246242:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246263:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246279:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201310.246282:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201310.246288:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246295:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472090d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246310:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246317:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246324:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246329:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.246667:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246676:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246685:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cdf8193a200) 00010000:00010000:3.0:1788201310.246689:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201310.246692:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246709:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720914 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246792:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720906 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246809:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.246816:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:3.0:1788201310.246818:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201310.246820:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:3.0:1788201310.246905:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+23:11320:x1875064662313088:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1410us (1667us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788201310.246914:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 96 00000100:00100000:3.0:1788201310.249228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201310.249294:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662313216 00000100:00100000:1.0:1788201310.249305:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662313216 00000100:00100000:1.0:1788201310.249548:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:1.0:1788201310.249560:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+23:11320:x1875064662313216:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:1.0:1788201310.249644:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249662:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249674:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249716:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249724:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249774:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249782:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201310.249787:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249795:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249809:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:1.0:1788201310.249812:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201310.249816:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.249823:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720929 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201310.249904:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+23:11320:x1875064662313216:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 345us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201310.249911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:3.0:1788201310.253893:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.253950:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662313472 00000100:00100000:3.0:1788201310.253963:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662313472 00000100:00100000:3.0:1788201310.254028:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201310.254039:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+23:11320:x1875064662313472:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1788201310.254328:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+24:11320:x1875064662313472:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 289us (445us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788201310.254337:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201310.290990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201310.291143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662313728 00000100:00100000:1.0:1788201310.291157:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662313728 00000100:00100000:1.0:1788201310.291228:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 98 00000100:00100000:1.0:1788201310.291240:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+24:10838:x1875064662313728:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201310.291273:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201310.291298:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720930 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc11b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.291537:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.291555:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.291563:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.291603:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.291688:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 25 pid: 6515 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201310.291706:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8372e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681269888:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201310.291840:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201310.300562:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.300879:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662313856 00000100:00100000:2.0:1788201310.300892:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662313856 00010000:00010000:2.0:1788201310.300954:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 26 pid: 6515 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.301009:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1788201310.301023:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+26:2399:x1875064662313856:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201310.301042:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201310.301051:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 26 pid: 6515 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.301086:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 26 pid: 6515 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.301115:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:2.0:1788201310.301121:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.301127:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472091b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc114 expref: 26 pid: 6515 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.301134:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.301145:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201310.301150:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8372e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681269888:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201310.301170:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201310.301183:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.301195:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.301214:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.301237:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+25:2399:x1875064662313856:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 217us (687us total) trans 0 rc 0/0 00000004:00200000:1.0:1788201310.301238:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000100:00100000:2.0:1788201310.301250:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00010000:00010000:1.0:1788201310.301403:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720930 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.301419:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.301428:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:1.0:1788201310.301432:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201310.301434:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255a00, rc 0) 00000100:00100000:1.0:1788201310.301463:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+25:10838:x1875064662313728:12345-192.168.203.2@tcp:101:bash.0 Request processed in 10225us (10485us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788201310.301470:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 98 00000100:00100000:0.0:1788201310.306358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.307144:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662313984 00000100:00100000:2.0:1788201310.307463:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662313984 00000100:00100000:2.0:1788201310.307541:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:2.0:1788201310.307554:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+25:10838:x1875064662313984:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201310.307590:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201310.307617:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720945 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc122 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.307664:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee4472094c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.307705:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee4472094c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.307719:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee4472094c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.307912:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720945 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc122 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.307945:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee4472094c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc122 expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.307955:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:2.0:1788201310.307958:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201310.307963:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1a00, rc 0) 00000100:00100000:2.0:1788201310.308048:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+26:10838:x1875064662313984:12345-192.168.203.2@tcp:101:bash.0 Request processed in 497us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.308056:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:2.0:1788201310.310732:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201310.310867:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662314240 00000100:00100000:1.0:1788201310.310879:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662314240 00000100:00100000:1.0:1788201310.310956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00100000:1.0:1788201310.310969:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+26:10838:x1875064662314240:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:1.0:1788201310.311260:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.311282:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.311294:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201310.311370:0:6516:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788201310.311398:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032757c38 reply state 00000000e4069f4c transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.311413:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.311422:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:1.0:1788201310.311425:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201310.311430:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788201310.311472:0:6516:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788201310.311596:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:10838:x1875064662314240:12345-192.168.203.2@tcp:36:bash.0 Request processed in 628us (875us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788201310.311605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 100 00000020:00080000:1.0:1788201310.311611:0:6516:0:(tgt_main.c:807:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788201310.316299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201310.316582:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662314368 00000100:00100000:1.0:1788201310.316595:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662314368 00000100:00100000:1.0:1788201310.316671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 101 00000100:00100000:1.0:1788201310.316685:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+30:10838:x1875064662314368:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201310.316727:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201310.316792:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472095a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc129 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.316872:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472095a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc129 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.316889:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472095a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc129 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.316957:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:1.0:1788201310.316962:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201310.316967:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255e00, rc 0) 00000100:00100000:1.0:1788201310.317048:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+31:10838:x1875064662314368:12345-192.168.203.2@tcp:101:bash.0 Request processed in 365us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201310.317055:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 101 00000100:00100000:0.0:1788201310.323095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.323197:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662314496 00000100:00100000:2.0:1788201310.323209:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662314496 00000100:00100000:2.0:1788201310.323296:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:2.0:1788201310.323309:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:10838:x1875064662314496:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201310.323332:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201310.323359:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc130 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201310.323425:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a95c95a, atime: 0x6a95c958, ctime: 0x6a95c95a, blocks: 0x8 00010000:00010000:2.0:1788201310.323455:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1788201310.323461:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201310.323471:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.323495:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.323510:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0200, rc 0) 00000100:00100000:2.0:1788201310.323582:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:10838:x1875064662314496:12345-192.168.203.2@tcp:101:bash.0 Request processed in 276us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.323589:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00080000:1.0:1788201310.323669:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201310.326188:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201310.327373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201310.330085:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662314624 00000100:00100000:0.0:1788201310.330104:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662314624 00002000:00010000:0.0:1788201310.330167:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788201310.330173:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf836cb100 with x1875064662314624 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201310.330188:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf836cb100. 00000100:00100000:0.0:1788201310.330231:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1788201310.330242:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662314624:12345-192.168.203.2@tcp:10:bash.0 00002000:00010000:0.0:1788201310.330586:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788201310.330591:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788201306 -> 1788201309 00002000:00010000:0.0:1788201310.330594:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788201304 -> 1788201304 00002000:00010000:0.0:1788201310.330597:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788201306 -> 1788201309 00002000:00010000:0.0:1788201310.330613:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788201310.330719:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662314624:12345-192.168.203.2@tcp:10:bash.0 Request processed in 476us (3355us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788201310.330729:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00002000:00010000:0.0:1788201310.330733:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788201310.330764:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf836cb100 with x1875064662314624 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201310.330771:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf836cb100. 00000100:00100000:1.0:1788201310.336095:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681270144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201310.336199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201310.336235:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681270144 00000100:00100000:2.0:1788201310.336246:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681270144 00000100:00100000:1.0:1788201310.336269:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681270016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201310.336296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201310.336327:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681270016 00000100:00100000:0.0:1788201310.336332:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681270016 00000100:00100000:2.0:1788201310.336397:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201310.336407:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681270144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201310.336581:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201310.336644:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681270144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 237us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.336652:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788201310.336705:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201310.336823:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788201310.336832:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681270016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201310.336844:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201310.336878:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681270016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201310.336884:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788201310.337571:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681270144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201310.337591:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681270016:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201310.390284:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201310.396541:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.396650:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662314752 00000100:00100000:3.0:1788201310.396662:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662314752 00000100:00100000:3.0:1788201310.396780:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 102 00000100:00100000:3.0:1788201310.396793:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+31:11334:x1875064662314752:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:3.0:1788201310.396887:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.396909:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.396932:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.396953:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.396961:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.396968:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397059:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397069:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397076:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201310.397159:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397172:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397178:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397186:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397193:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.397198:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397205:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397220:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201310.397223:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201310.397233:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397242:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720968 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397261:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397267:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397278:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397283:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.397286:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397291:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397301:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cdf8193b300) 00010000:00010000:3.0:1788201310.397303:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201310.397305:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397310:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee4472096f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397326:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397332:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397337:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397341:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.397343:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397356:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397363:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:3.0:1788201310.397364:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201310.397367:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.397372:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720976 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201310.397456:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+31:11334:x1875064662314752:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 665us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201310.397464:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 102 00000100:00100000:0.0:1788201310.404428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201310.404479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.404569:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662314880 00000100:00100000:3.0:1788201310.404582:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662314880 00002000:00100000:3.0:1788201310.404649:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9ce0bf6abb80 x1875064662314880/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:431/0 lens 496/0 e 0 to 0 dl 1788201321 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201310.404662:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ce0bf6abb80 with x1875064662314880 ext(0->7) 00002000:00010000:3.0:1788201310.404668:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ce0bf6abb80 00000100:00100000:3.0:1788201310.404707:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1788201310.404719:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662314880:12345-192.168.203.2@tcp:4:bash.0 00000100:00100000:1.0:1788201310.405334:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662315008 00000100:00100000:1.0:1788201310.405341:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662315008 00000100:00100000:1.0:1788201310.405384:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:1.0:1788201310.405392:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2399:x1875064662315008:12345-192.168.203.2@tcp:16:kworker.0 00000100:00100000:2.0:1788201310.405849:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2399:x1875064662314880:12345-192.168.203.2@tcp:4:bash.0 Request processed in 1129us (1432us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788201310.405860:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00002000:00100000:2.0:1788201310.405879:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9ce0bf6abb80 x1875064662314880/t4294967308(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:431/0 lens 496/448 e 0 to 0 dl 1788201321 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201310.405889:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ce0bf6abb80 with x1875064662314880 ext(0->7) 00002000:00010000:2.0:1788201310.405894:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ce0bf6abb80 00000001:00080000:2.0:1788201310.410019:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788201310.410047:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1788201310.410295:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662315008:12345-192.168.203.2@tcp:16:kworker.0 Request processed in 4895us (5806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201310.410307:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1788201310.431102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201310.431231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662315264 00000100:00100000:1.0:1788201310.431243:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662315264 00000100:00100000:1.0:1788201310.431327:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 103 00000100:00100000:1.0:1788201310.431352:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+31:11337:x1875064662315264:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201310.431381:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201310.431407:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472097d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc137 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.431962:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.431983:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.431996:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432013:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432020:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432027:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432164:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720992 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432174:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432181:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201310.432206:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788201310.432310:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432320:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432328:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432335:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201310.432341:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432349:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432364:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:1.0:1788201310.432367:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201310.432372:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432380:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720984 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432396:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432403:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432421:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432427:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201310.432430:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.432437:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.433666:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc800) 00010000:00010000:1.0:1788201310.433676:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201310.433683:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.433693:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472098b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.433949:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472097d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc137 expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.433969:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720992 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc137 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.433977:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:1.0:1788201310.433980:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788201310.433982:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254000, rc 0) 00000100:00100000:1.0:1788201310.434079:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+33:11337:x1875064662315264:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 2729us (2990us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788201310.434105:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 103 00000100:00100000:0.0:1788201310.441039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.441154:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662315392 00000100:00100000:2.0:1788201310.441168:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662315392 00000100:00100000:2.0:1788201310.441253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 104 00000100:00100000:2.0:1788201310.441266:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+33:11337:x1875064662315392:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:2.0:1788201310.441357:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.441381:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.441392:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.441564:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.441580:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 33 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.441598:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681270272:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201310.441837:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201310.454064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.454380:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662315648 00000100:00100000:3.0:1788201310.454392:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662315648 00000100:00100000:2.0:1788201310.454540:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681270272:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201310.454593:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201310.455592:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201310.455605:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+34:6169:x1875064662315648:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788201310.456874:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+35:6169:x1875064662315648:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 1263us (2818us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788201310.456901:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:0.0:1788201310.465083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.465222:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662315776 00000100:00100000:2.0:1788201310.465235:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662315776 00010000:00010000:2.0:1788201310.465284:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 35 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.465369:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:2.0:1788201310.465382:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+35:2399:x1875064662315776:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201310.465411:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201310.465419:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 35 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.465436:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 35 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.465463:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720937 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc11b expref: 35 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.465485:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:2.0:1788201310.465492:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.465504:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.465513:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.465575:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201310.465649:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+34:2399:x1875064662315776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 268us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.465658:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00010000:00010000:3.0:1788201310.466596:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.466972:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.467033:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.467041:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.467049:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.467056:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.467061:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.467069:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.467086:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:3.0:1788201310.467089:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201310.467093:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.467100:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447209a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201310.467204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+33:11337:x1875064662315392:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 25935us (26179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201310.467235:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 104 00000100:00100000:0.0:1788201310.470333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.470452:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662316032 00000100:00100000:3.0:1788201310.470464:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662316032 00000100:00100000:3.0:1788201310.470546:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1788201310.470557:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+33:11337:x1875064662316032:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1788201310.471206:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+34:11337:x1875064662316032:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 647us (883us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788201310.471216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:1.0:1788201310.568179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.568300:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662316288 00000100:00100000:3.0:1788201310.568312:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662316288 00000100:00100000:3.0:1788201310.568389:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 105 00000100:00100000:3.0:1788201310.568402:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+34:11348:x1875064662316288:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1788201310.568448:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201310.568475:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447209a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc13e expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.568865:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.568883:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.568896:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.568914:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569068:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569079:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569226:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447209bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569237:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447209bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569244:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447209bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201310.569257:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788201310.569360:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569368:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569376:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569383:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.569388:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569397:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569438:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201310.569442:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201310.569448:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569455:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.569475:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.570111:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.570123:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.570129:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.570133:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.570140:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.570151:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cdf8193b300) 00010000:00010000:3.0:1788201310.570154:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201310.570158:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.570164:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.572723:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447209a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc13e expref: 37 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.572945:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447209bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc13e expref: 36 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.573021:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:2.0:1788201310.573025:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201310.573030:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb800, rc 0) 00000100:00100000:2.0:1788201310.573186:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+36:11348:x1875064662316288:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4785us (5022us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788201310.573197:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 105 00000100:00100000:0.0:1788201310.588253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.588404:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662316544 00000100:00100000:2.0:1788201310.588426:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662316544 00000100:00100000:2.0:1788201310.588512:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1788201310.588526:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+36:11348:x1875064662316544:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1788201310.589019:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+37:11348:x1875064662316544:12345-192.168.203.2@tcp:35:cat.0 Request processed in 493us (778us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788201310.589028:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1788201310.612672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201310.612787:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662316800 00000100:00100000:1.0:1788201310.612800:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662316800 00000100:00100000:1.0:1788201310.612874:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 106 00000100:00100000:1.0:1788201310.612886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+37:11349:x1875064662316800:12345-192.168.203.2@tcp:36:rm.0 00010000:00010000:1.0:1788201310.612979:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788201310.614120:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472095a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc129 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614159:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447209bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc13e expref: 36 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614178:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720992 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc137 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614191:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee4472094c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc122 expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614203:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:1.0:1788201310.614208:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201310.614240:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614257:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614268:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614322:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614331:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.614339:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.615545:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.615567:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.616906:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201310.617683:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788201310.617697:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390914957887ns, next at 391914954921ns, rc = 0 00010000:00010000:1.0:1788201310.617805:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617823:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617835:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617844:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617870:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617876:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617911:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201310.617949:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617956:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617961:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617967:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201310.617971:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.617979:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618185:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:1.0:1788201310.618190:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201310.618196:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618203:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447209d8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618229:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618244:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618250:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618255:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201310.618259:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618264:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618273:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:1.0:1788201310.618276:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201310.618278:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618295:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447209ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201310.618308:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9a009dc reply state 0000000044c63e0f transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618318:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.618324:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc800) 00010000:00010000:1.0:1788201310.618327:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201310.618330:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201310.618690:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201310.618699:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.618714:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201310.618718:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.618775:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.618787:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:0.0:1788201310.618790:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201310.618794:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.618799:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447209df lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.618813:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201310.618815:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201310.618817:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201310.618879:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+35:11349:x1875064662316800:12345-192.168.203.2@tcp:36:rm.0 Request processed in 5987us (6214us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788201310.618895:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 106 00000100:00100000:1.0:1788201310.650957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.651099:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662317056 00000100:00100000:3.0:1788201310.651112:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662317056 00000100:00100000:3.0:1788201310.651292:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:3.0:1788201310.651305:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+35:11355:x1875064662317056:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201310.651340:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201310.651368:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc145 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.651519:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.651538:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.651551:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.651564:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.651571:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.651578:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201310.656601:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788201310.656948:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.656988:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.657905:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.657979:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.657987:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658347:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658355:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201310.658360:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658368:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658385:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201310.658388:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201310.658393:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658400:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447209ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201310.658423:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae012825 reply state 00000000531125e0 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658452:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658459:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc800) 00010000:00010000:2.0:1788201310.658462:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201310.658466:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201310.658520:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447209e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658538:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.658545:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ce0839b3500) 00010000:00010000:2.0:1788201310.658547:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201310.658549:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1200, rc 0) 00000100:00100000:2.0:1788201310.658652:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+38:11355:x1875064662317056:12345-192.168.203.2@tcp:101:bash.0 Request processed in 7348us (7711us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788201310.658662:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:3.0:1788201310.669629:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.669829:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662317184 00000100:00100000:2.0:1788201310.669842:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662317184 00000100:00100000:2.0:1788201310.669983:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:2.0:1788201310.670004:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662317184:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201310.670028:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201310.670056:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc14c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201310.670090:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201310.670136:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1788201310.670142:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201310.670155:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.670179:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.670195:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1600, rc 0) 00000100:00100000:2.0:1788201310.670271:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662317184:12345-192.168.203.2@tcp:101:bash.0 Request processed in 278us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.670279:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00080000:3.0:1788201310.678845:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201310.679088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.679235:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662317312 00000100:00100000:3.0:1788201310.679265:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662317312 00000100:00100000:3.0:1788201310.679823:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:3.0:1788201310.679837:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:11355:x1875064662317312:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201310.679862:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201310.679887:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc153 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.679938:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.679949:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201310.679955:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201310.679961:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.680388:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.680410:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 9 pid: 8432 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201310.680429:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875064681270400:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201310.680640:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201310.687507:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875064681270400:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201310.687559:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.687616:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba600, rc 0) 00000100:00100000:1.0:1788201310.689440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.689663:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662317440 00000100:00100000:3.0:1788201310.689674:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662317440 00010000:00010000:3.0:1788201310.689886:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 10 pid: 8432 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201310.689949:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:3.0:1788201310.689962:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+10:2398:x1875064662317440:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201310.689983:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201310.690116:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 10 pid: 8432 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.690133:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 10 pid: 8432 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.690162:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013253b1f/0xf9b71aee44720a09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc14c expref: 10 pid: 8432 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.690194:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201310.690199:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201310.690210:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.690222:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.690417:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201310.690440:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1875064681270528:192.168.203.2@tcp:105: 00000100:00100000:3.0:1788201310.690656:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201310.690910:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+9:11355:x1875064662317312:12345-192.168.203.2@tcp:101:bash.0 Request processed in 11074us (11827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.690931:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:3.0:1788201310.694845:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1875064681270528:192.168.203.2@tcp:105: 00010000:00010000:3.0:1788201310.694880:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201310.694965:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662317440:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5005us (5536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201310.694978:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:0.0:1788201310.697039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.697160:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662317696 00000100:00100000:2.0:1788201310.697184:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662317696 00000100:00100000:2.0:1788201310.697256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1788201310.697268:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+38:11355:x1875064662317696:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:2.0:1788201310.697665:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+39:11355:x1875064662317696:12345-192.168.203.2@tcp:35:bash.0 Request processed in 398us (637us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788201310.697674:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1788201310.851491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.851593:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662317824 00000100:00100000:2.0:1788201310.851607:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662317824 00000100:00100000:2.0:1788201310.851688:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 108 00000100:00100000:2.0:1788201310.851701:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+39:11371:x1875064662317824:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201310.852928:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201310.852959:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc15a expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.853049:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720a1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.853067:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.853086:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201310.853150:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788201310.853156:0:8476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201310.853180:0:8476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.853213:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc15a expref: 41 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.853235:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720a1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc15a expref: 40 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.853245:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201310.853248:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201310.853253:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0000, rc 0) 00000100:00100000:2.0:1788201310.853340:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+40:11371:x1875064662317824:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1641us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.853349:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 108 00000100:00100000:0.0:1788201310.862083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201310.863445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662318080 00000100:00100000:1.0:1788201310.863463:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662318080 00000100:00100000:1.0:1788201310.863552:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 109 00000100:00100000:1.0:1788201310.863566:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+40:11371:x1875064662318080:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201310.863595:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201310.863622:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720a25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc161 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.864121:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720a2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.864140:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720a2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.864155:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720a2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201310.864169:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788201310.864307:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720a25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc161 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.864333:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720a2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc161 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.864368:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ce0839b3500) 00010000:00010000:1.0:1788201310.864371:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201310.864376:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255e00, rc 0) 00000100:00100000:1.0:1788201310.864508:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+42:11371:x1875064662318080:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 944us (2439us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1788201310.864517:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 109 00000100:00100000:0.0:1788201310.881263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201310.881346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.881446:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662318336 00000100:00100000:2.0:1788201310.881460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662318336 00000100:00100000:2.0:1788201310.881531:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 110 00000100:00100000:2.0:1788201310.881544:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+42:11371:x1875064662318336:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201310.881578:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201310.881604:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720a3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc168 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.881783:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720a41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.881801:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720a41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.881816:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720a41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201310.881831:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788201310.881976:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720a3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc168 expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.881998:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720a41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc168 expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.882007:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ce0839b3500) 00010000:00010000:2.0:1788201310.882011:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788201310.882015:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1e00, rc 0) 00000100:00100000:2.0:1788201310.882096:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+44:11371:x1875064662318336:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 554us (850us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788201310.882115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 110 00000100:00100000:1.0:1788201310.883280:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662318464 00000100:00100000:1.0:1788201310.883292:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662318464 00000100:00100000:1.0:1788201310.883374:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1788201310.883386:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+44:2398:x1875064662318464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201310.883402:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201310.883429:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720a2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc161 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.883449:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ce0839b3500) 00010000:00010000:1.0:1788201310.883454:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201310.883522:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+43:2398:x1875064662318464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 138us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201310.883530:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1788201310.891354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.891449:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662318592 00000100:00100000:2.0:1788201310.891463:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662318592 00000100:00100000:2.0:1788201310.891537:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:2.0:1788201310.891549:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662318592:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:2.0:1788201310.891610:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.891636:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.891646:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788201310.891651:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201310.891656:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.891703:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.891719:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 8 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.891783:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875064681270656:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201310.891892:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201310.903546:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201310.903692:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875064681270656:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201310.903777:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201310.904879:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662318720 00000100:00100000:3.0:1788201310.904894:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662318720 00002000:00100000:3.0:1788201310.904978:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9cdf837a6a00 x1875064662318720/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:431/0 lens 504/0 e 0 to 0 dl 1788201321 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201310.904991:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf837a6a00 with x1875064662318720 ext(0->8) 00010000:00010000:3.0:1788201310.905000:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.905019:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201310.905026:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cdf837a6a00 00000100:00100000:3.0:1788201310.905068:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:3.0:1788201310.905080:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2399:x1875064662318720:12345-192.168.203.2@tcp:4:lfs.0 00000100:00100000:1.0:1788201310.913390:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2399:x1875064662318720:12345-192.168.203.2@tcp:4:lfs.0 Request processed in 8296us (9842us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788201310.913411:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00002000:00100000:1.0:1788201310.913427:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9cdf837a6a00 x1875064662318720/t4294967303(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:431/0 lens 504/448 e 0 to 0 dl 1788201321 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201310.913465:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf837a6a00 with x1875064662318720 ext(0->8) 00010000:00010000:1.0:1788201310.913597:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 11 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201310.913620:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 11 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201310.913629:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cdf837a6a00 00000001:00080000:1.0:1788201310.914604:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1788201310.914623:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1788201310.918433:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.918567:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662318848 00000100:00100000:2.0:1788201310.918587:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662318848 00010000:00010000:2.0:1788201310.918639:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.918697:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:2.0:1788201310.918710:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2398:x1875064662318848:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201310.918797:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788201310.918820:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788201310.918823:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788201310 00002000:00010000:2.0:1788201310.918826:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788201310 00002000:00010000:2.0:1788201310.918828:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788201310 00002000:00010000:2.0:1788201310.918830:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788201310.918838:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.918856:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.918886:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a38df01e/0xf9b71aee44720a10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc153 expref: 9 pid: 8431 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.918906:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201310.918911:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201310.918930:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.918941:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.918984:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201310.919296:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662318848:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 586us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.919307:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00010000:00010000:0.0:1788201310.919427:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.919439:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.919466:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.919475:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.919483:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.919492:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201310.919497:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.919507:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.919523:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201310.919531:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009687503d/0xf9b71aee44720a4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201310.919603:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662318592:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 28056us (28263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201310.919612:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:0.0:1788201310.927308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201310.927618:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662319104 00000100:00100000:2.0:1788201310.927631:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662319104 00000100:00100000:2.0:1788201310.928102:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:2.0:1788201310.928116:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf40050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+43:11371:x1875064662319104:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:2.0:1788201310.928270:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720a41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc168 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201310.930806:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788201310.930913:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788201310.931376:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788201310.931425:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.931450:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.931461:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.931512:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.931531:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 47 pid: 6515 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.931571:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875064681270784:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201310.931700:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201310.936414:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875064681270784:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201310.936454:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201310.936614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.944593:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662319232 00000100:00100000:3.0:1788201310.944618:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662319232 00010000:00010000:2.0:1788201310.947241:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 48 pid: 6515 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.949141:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:2.0:1788201310.949174:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+48:2398:x1875064662319232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201310.949202:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201310.949214:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 48 pid: 6515 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.949235:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 48 pid: 6515 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.949266:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447209fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc145 expref: 48 pid: 6515 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.949287:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ce0839b3500) 00010000:00010000:2.0:1788201310.949292:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.949329:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.949336:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201310.949381:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201310.949458:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+47:2398:x1875064662319232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 302us (12844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.949467:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00010000:00010000:3.0:1788201310.949545:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.949557:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201310.949722:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788201310.949877:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788201310.950215:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681270912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788201310.950284:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201310.950318:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201310.951390:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681270912 00000100:00100000:3.0:1788201310.951402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681270912 00000100:00100000:3.0:1788201310.951506:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788201310.951517:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681270912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788201310.951646:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681270912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 131us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201310.951663:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788201310.951797:0:6518:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1788201310.951803:0:6518:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1788201310.951824:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ce0bf6a9f80, transno 4294967302 00000100:00100000:0.0:1788201310.951840:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681270912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788201310.952015:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788201310.952095:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681271040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788201310.952135:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201310.952157:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201310.954013:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681271040 00000100:00100000:2.0:1788201310.954029:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681271040 00000100:00100000:2.0:1788201310.954096:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788201310.954109:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681271040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788201310.954360:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6518:x1875064681271040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 252us (2221us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788201310.954369:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1788201310.954454:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201310.954609:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681271040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788201310.955167:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788201310.955364:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.955377:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.955386:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.955394:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201310.955400:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.955427:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.955447:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ce0839b3500) 00010000:00010000:3.0:1788201310.955451:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788201310.955456:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.955463:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720a56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201310.955876:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788201310.956200:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788201310.956217:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391253477164ns, next at 392253473039ns, rc = 0 00000001:00080000:2.0:1788201310.956227:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788201310.956268:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ce0839b3500) 00010000:00010000:2.0:1788201310.956272:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788201310.956283:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720a41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc168 expref: 51 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201310.956464:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf40050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+50:11371:x1875064662319104:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 28350us (29169us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788201310.956474:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000020:00080000:2.0:1788201310.956482:0:6518:0:(tgt_main.c:807:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788201310.964463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.972354:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662319360 00000100:00100000:3.0:1788201310.972375:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662319360 00000100:00100000:3.0:1788201310.972830:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 111 00000100:00100000:3.0:1788201310.972845:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+50:11371:x1875064662319360:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201310.972877:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201310.973133:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720a5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc16f expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.973231:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720a5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc16f expref: 51 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.973249:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720a5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc16f expref: 51 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201310.973272:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:3.0:1788201310.973275:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201310.973298:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb600, rc 0) 00000100:00100000:3.0:1788201310.973381:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+51:11371:x1875064662319360:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 539us (8930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201310.973389:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 111 00000100:00100000:1.0:1788201310.980358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201310.980538:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662319616 00000100:00100000:3.0:1788201310.980550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662319616 00000100:00100000:3.0:1788201310.980823:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1788201310.980836:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+51:11371:x1875064662319616:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1788201310.981171:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+52:11371:x1875064662319616:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 337us (825us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788201310.981189:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1788201311.061545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.061656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662319744 00000100:00100000:3.0:1788201311.061669:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662319744 00000100:00100000:3.0:1788201311.061783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 112 00000100:00100000:3.0:1788201311.061795:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+52:11381:x1875064662319744:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:3.0:1788201311.061892:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.061912:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.061939:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.061956:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.061964:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.061994:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062089:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062098:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062106:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201311.062173:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062188:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062195:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062203:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062211:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.062216:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062225:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062240:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201311.062249:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201311.062255:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062262:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062282:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062288:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062295:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062302:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.062305:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062311:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062319:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc800) 00010000:00010000:3.0:1788201311.062322:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201311.062325:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062331:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062340:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062351:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062357:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062362:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.062366:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062372:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062379:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:3.0:1788201311.062381:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201311.062384:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.062390:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.062584:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+52:11381:x1875064662319744:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 789us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.062593:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 112 00000100:00100000:0.0:1788201311.099806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.100311:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662320000 00000100:00100000:3.0:1788201311.100324:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662320000 00000100:00100000:3.0:1788201311.100399:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 113 00000100:00100000:3.0:1788201311.100419:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+52:11384:x1875064662320000:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201311.100449:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201311.100495:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc176 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100605:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100622:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100635:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100647:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100654:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100659:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100842:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100851:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100859:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201311.100869:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788201311.100975:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.100995:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101003:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101010:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.101015:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101024:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101040:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201311.101043:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201311.101048:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101054:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720a80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101074:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101081:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101087:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101093:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.101102:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101110:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101118:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc800) 00010000:00010000:3.0:1788201311.101121:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201311.101124:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101130:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720a87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101187:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 55 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101204:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 54 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.101211:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:3.0:1788201311.101214:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201311.101217:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:3.0:1788201311.101287:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+54:11384:x1875064662320000:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 872us (1551us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788201311.101296:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 113 00000100:00100000:1.0:1788201311.108944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.109040:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662320128 00000100:00100000:3.0:1788201311.109052:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662320128 00000100:00100000:3.0:1788201311.109127:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 114 00000100:00100000:3.0:1788201311.109140:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+54:11384:x1875064662320128:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:3.0:1788201311.109250:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109271:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109285:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109332:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109340:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109347:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109355:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.109360:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109369:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109381:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:3.0:1788201311.109385:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201311.109391:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.109398:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720a9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.109523:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+54:11384:x1875064662320128:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 384us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.109532:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 114 00000100:00100000:1.0:1788201311.117203:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.117342:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662320384 00000100:00100000:2.0:1788201311.117355:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662320384 00000100:00100000:2.0:1788201311.117429:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:2.0:1788201311.117441:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+54:11384:x1875064662320384:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201311.117815:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+55:11384:x1875064662320384:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 375us (626us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788201311.117825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:0.0:1788201311.186057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.186196:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662320640 00000100:00100000:2.0:1788201311.186210:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662320640 00000100:00100000:2.0:1788201311.186286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:2.0:1788201311.186299:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+55:11394:x1875064662320640:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201311.186335:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.186340:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201311.186386:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720a1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc15a expref: 55 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.186669:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201311.186675:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201311.186695:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720aa3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc17d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.186931:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.186949:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 55 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.186958:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.187001:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 55 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.187016:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 55 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.187033:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681271168:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201311.187169:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.197257:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681271168:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201311.197273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1788201311.197298:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201311.197541:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662320768 00000100:00100000:0.0:1788201311.197551:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662320768 00010000:00010000:0.0:1788201311.197600:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 56 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201311.197650:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:0.0:1788201311.197662:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+56:2398:x1875064662320768:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201311.197681:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201311.197689:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 56 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.197720:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 56 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.197777:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720a8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc176 expref: 56 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.197798:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:0.0:1788201311.197804:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.197815:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.197824:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.197925:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201311.198003:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+55:2398:x1875064662320768:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 342us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.198012:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00010000:00010000:2.0:1788201311.207030:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.207054:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201311.207085:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788201311.207316:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720aa3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 56 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.207340:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.207351:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.207354:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201311.207357:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1200, rc 0) 00000100:00100000:2.0:1788201311.207471:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+55:11394:x1875064662320640:12345-192.168.203.2@tcp:101:bash.0 Request processed in 21174us (21429us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788201311.207481:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:1.0:1788201311.213172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201311.213272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662320896 00000100:00100000:0.0:1788201311.213284:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662320896 00000100:00100000:0.0:1788201311.213349:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:0.0:1788201311.213360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+55:11394:x1875064662320896:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1788201311.213410:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201311.213437:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee44720ab8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc184 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.213505:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.213522:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.213553:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.213699:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee44720ab8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.213734:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 56 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.213788:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:0.0:1788201311.213792:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201311.213796:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367ce00, rc 0) 00000100:00100000:0.0:1788201311.213865:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+56:11394:x1875064662320896:12345-192.168.203.2@tcp:101:bash.0 Request processed in 507us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.213873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:1.0:1788201311.218953:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.219080:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662321152 00000100:00100000:3.0:1788201311.219092:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662321152 00000100:00100000:3.0:1788201311.219217:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:3.0:1788201311.219229:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+56:11394:x1875064662321152:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:3.0:1788201311.219878:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.219904:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.219929:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201311.219995:0:10723:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788201311.220026:0:10723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7611440 reply state 000000003439c43b transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.220041:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.220051:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:3.0:1788201311.220054:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201311.220058:0:10723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201311.220315:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11394:x1875064662321152:12345-192.168.203.2@tcp:36:bash.0 Request processed in 1085us (1373us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788201311.220324:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 117 00000020:00080000:3.0:1788201311.220348:0:10723:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201311.225224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.225301:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662321280 00000100:00100000:2.0:1788201311.225314:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662321280 00000100:00100000:2.0:1788201311.225448:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:2.0:1788201311.225462:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11394:x1875064662321280:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201311.225504:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.225540:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720acd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc18b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.225660:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.225678:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.225689:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.226029:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.226045:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 60 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.226064:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681271296:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201311.226273:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201311.231376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.231664:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662321408 00000100:00100000:3.0:1788201311.231675:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662321408 00010000:00010000:3.0:1788201311.231727:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 61 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.231807:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:3.0:1788201311.231819:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+61:2399:x1875064662321408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201311.231838:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201311.231847:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 61 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.231863:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 61 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.231891:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:3.0:1788201311.231896:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.231909:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.231928:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.231953:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201311.232019:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+61:2399:x1875064662321408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 201us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.232027:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 71 00010000:00010000:2.0:1788201311.233127:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720aaa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc17d expref: 60 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.233153:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681271296:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201311.233318:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.233329:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.233335:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201311.233608:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788201311.233614:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201311.233643:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.233686:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720acd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.233941:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.233951:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.233955:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201311.233958:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0000, rc 0) 00000100:00100000:2.0:1788201311.234032:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11394:x1875064662321280:12345-192.168.203.2@tcp:101:bash.0 Request processed in 8574us (8820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.234041:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:1.0:1788201311.237593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.239257:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662321664 00000100:00100000:2.0:1788201311.239278:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662321664 00000100:00100000:2.0:1788201311.239365:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:2.0:1788201311.239380:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+59:11394:x1875064662321664:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:2.0:1788201311.240055:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11394:x1875064662321664:12345-192.168.203.2@tcp:35:bash.0 Request processed in 674us (2469us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788201311.240066:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1788201311.303642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.304838:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662321792 00000100:00100000:2.0:1788201311.304855:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662321792 00000100:00100000:2.0:1788201311.305409:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:2.0:1788201311.305425:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+60:11400:x1875064662321792:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201311.305458:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.305485:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.305571:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720ae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.305606:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.305630:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201311.305697:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788201311.305703:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201311.305725:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.305792:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc192 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.305815:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc192 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.305825:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201311.305829:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201311.305832:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1200, rc 0) 00000100:00100000:2.0:1788201311.305930:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11400:x1875064662321792:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 509us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.305938:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:0.0:1788201311.313283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.313367:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662321920 00000100:00100000:3.0:1788201311.313399:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662321920 00000100:00100000:3.0:1788201311.313528:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:3.0:1788201311.313541:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11400:x1875064662321920:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201311.313569:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201311.313608:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720ae9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc199 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314017:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314036:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314050:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314065:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314072:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314078:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314189:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314200:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314588:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201311.314782:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788201311.314788:0:10723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201311.314815:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314830:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314839:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314847:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314855:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314861:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.314866:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314873:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314887:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:3.0:1788201311.314891:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201311.314897:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314903:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720af0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314946:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314952:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314958:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314964:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.314967:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314974:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314984:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc800) 00010000:00010000:3.0:1788201311.314986:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201311.314990:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.314995:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720af7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.315032:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720ae9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 63 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.315047:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 62 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.315067:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:3.0:1788201311.315069:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201311.315072:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba200, rc 0) 00000100:00100000:3.0:1788201311.315173:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11400:x1875064662321920:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1634us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.315181:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:3.0:1788201311.320033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.320092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.320212:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662322304 00000100:00100000:2.0:1788201311.320224:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662322304 00000100:00100000:2.0:1788201311.320301:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:2.0:1788201311.320316:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11400:x1875064662322304:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201311.320346:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.320391:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1a0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.320539:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.320556:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.320565:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 63 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.320575:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.320620:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 63 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.320636:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 63 pid: 10723 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.320664:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681271424:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201311.320825:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.320835:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 63 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.320845:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681271552:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201311.320880:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.321083:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662322048 00000100:00100000:0.0:1788201311.321089:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662322048 00010000:00010000:0.0:1788201311.321117:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 64 pid: 10723 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201311.321152:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:0.0:1788201311.321168:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+64:2399:x1875064662322048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201311.321181:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201311.321188:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 64 pid: 10723 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.321212:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 64 pid: 10723 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.321233:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:0.0:1788201311.321238:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.321245:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.321251:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201311.321283:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+64:2399:x1875064662322048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 116us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.321291:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00010000:00010000:2.0:1788201311.323997:0:6516:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from blocking AST (req@00000000a3da35b6 x1875064681271424) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 63 pid: 10723 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.324027:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720afe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc199 expref: 63 pid: 10723 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.324050:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681271424:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201311.324067:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681271552:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201311.324098:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.324105:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.324115:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.324125:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.325718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201311.326232:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662322432 00000100:00100000:0.0:1788201311.326243:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662322432 00010000:00010000:0.0:1788201311.326295:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 63 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201311.326346:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:0.0:1788201311.326358:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+63:2399:x1875064662322432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201311.326377:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201311.326385:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 63 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.326419:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 63 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.326447:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44720ad4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc18b expref: 63 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.326463:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:0.0:1788201311.326468:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.326478:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.326486:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.326537:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201311.326760:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.326770:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201311.326793:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788201311.326970:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.327001:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.327010:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.327013:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201311.327015:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0800, rc 0) 00000100:00100000:0.0:1788201311.327088:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+63:2399:x1875064662322432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 729us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.327098:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:2.0:1788201311.328075:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11400:x1875064662322304:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 7758us (7976us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788201311.328085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:0.0:1788201311.335980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.336083:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662322688 00000100:00100000:1.0:1788201311.336095:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662322688 00000100:00100000:1.0:1788201311.336334:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:1.0:1788201311.336348:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11400:x1875064662322688:12345-192.168.203.2@tcp:103:lfs.0 00010000:00010000:1.0:1788201311.336389:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201311.336421:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720a5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc16f expref: 62 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.336445:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:1.0:1788201311.336452:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201311.336523:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11400:x1875064662322688:12345-192.168.203.2@tcp:103:lfs.0 Request processed in 178us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.336532:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1788201311.338726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.338895:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662322816 00000100:00100000:2.0:1788201311.338906:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662322816 00000100:00100000:2.0:1788201311.338972:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:2.0:1788201311.338982:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11400:x1875064662322816:12345-192.168.203.2@tcp:58:lfs.0 00010000:00010000:2.0:1788201311.339131:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.339152:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.339177:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201311.339392:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788201311.339481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11400:x1875064662322816:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 500us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.339490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:3.0:1788201311.342290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.342572:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662322944 00000100:00100000:2.0:1788201311.342607:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662322944 00000100:00100000:2.0:1788201311.342681:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1788201311.342694:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+61:11400:x1875064662322944:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201311.342733:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.342795:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1a7 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.342867:0:10723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.342880:0:10723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 62 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.342902:0:10723:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.342927:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 62 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.342943:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.342946:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201311.342951:0:10723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 62 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.342958:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0c00, rc 0) 00000100:00100000:2.0:1788201311.343022:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11400:x1875064662322944:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 331us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.343030:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00000040:00080000:2.0:1788201311.350638:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201311.350652:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201311.350688:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788201311.350697:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201311.351557:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681271680:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201311.351981:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.357502:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681271680:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788201311.363010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.363217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662323072 00000100:00100000:2.0:1788201311.363232:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662323072 00000100:00100000:2.0:1788201311.363348:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:2.0:1788201311.363361:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11401:x1875064662323072:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788201311.363403:0:6516:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788201311.363602:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11401:x1875064662323072:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 242us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.363611:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:3.0:1788201311.371549:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.371838:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662323200 00000100:00100000:1.0:1788201311.371852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662323200 00000100:00100000:1.0:1788201311.371997:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:1.0:1788201311.372011:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11401:x1875064662323200:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788201311.372111:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372132:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372146:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372292:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372302:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372310:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372353:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372365:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372372:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201311.372434:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788201311.372439:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201311.372455:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372468:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372476:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372483:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372491:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201311.372496:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372505:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372519:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:1.0:1788201311.372531:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201311.372537:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372544:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720b28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372563:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372569:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372576:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372591:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201311.372594:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372600:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372609:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9ce089cc2d00) 00010000:00010000:1.0:1788201311.372612:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201311.372614:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372620:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.372638:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.373084:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.373092:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.373097:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201311.373101:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.373108:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.373118:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:1.0:1788201311.373120:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201311.373124:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.373129:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.373284:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11401:x1875064662323200:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 1273us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.373295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:3.0:1788201311.376627:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.376764:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662323456 00000100:00100000:2.0:1788201311.376776:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662323456 00000100:00100000:2.0:1788201311.376842:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:2.0:1788201311.376854:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+62:11401:x1875064662323456:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201311.376884:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.376922:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1ae expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377069:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377086:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377118:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201311.377134:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788201311.377370:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377379:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377386:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377393:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.377398:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377406:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377421:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.377425:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201311.377431:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377437:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377486:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b3d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1ae expref: 64 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377510:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:2.0:1788201311.377512:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201311.377517:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1ae expref: 64 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.377528:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1e00, rc 0) 00000100:00100000:2.0:1788201311.377607:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+63:11401:x1875064662323456:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 755us (991us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788201311.377617:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:3.0:1788201311.380635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.380972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662323584 00000100:00100000:2.0:1788201311.380985:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662323584 00000100:00100000:2.0:1788201311.381239:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:2.0:1788201311.381252:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+63:11401:x1875064662323584:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788201311.381313:0:6516:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788201311.381466:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+63:11401:x1875064662323584:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 217us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.381474:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:3.0:1788201311.385058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.385543:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662323840 00000100:00100000:1.0:1788201311.385557:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662323840 00000100:00100000:1.0:1788201311.385875:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:1.0:1788201311.385890:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+63:11401:x1875064662323840:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201311.385936:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201311.385956:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201311.385997:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720ae2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc192 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.386022:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:1.0:1788201311.386028:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201311.386044:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201311.387640:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788201311.388131:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.388152:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.388176:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.388259:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1b5 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.388282:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1b5 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.388292:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce089cc2d00) 00010000:00010000:1.0:1788201311.388295:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201311.388299:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201311.388448:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+64:11401:x1875064662323840:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2561us (3402us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788201311.388469:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:3.0:1788201311.392130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.392342:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662324096 00000100:00100000:2.0:1788201311.392355:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662324096 00000100:00100000:2.0:1788201311.392461:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:2.0:1788201311.392475:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+64:11401:x1875064662324096:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201311.392556:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201311.392592:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720b59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1b5 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.392639:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce089cc2d00) 00010000:00010000:2.0:1788201311.392652:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201311.392679:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.392695:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.392706:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.392950:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.392973:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.392984:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393043:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393051:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393057:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393063:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.393066:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393088:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393100:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201311.393103:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.393108:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393114:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393130:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393136:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393140:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393145:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.393147:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393152:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393157:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3dc33a8c (ffff9ce0839b3500) 00010000:00010000:2.0:1788201311.393160:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.393162:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.393177:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3dc33a8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.393359:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+63:11401:x1875064662324096:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 882us (1238us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201311.393369:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:3.0:1788201311.396513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.399181:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662324224 00000100:00100000:2.0:1788201311.399200:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662324224 00000100:00100000:2.0:1788201311.399294:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:2.0:1788201311.399306:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+63:11401:x1875064662324224:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201311.399328:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.399353:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720b75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1bc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.399394:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.399406:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.399417:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.399534:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720b75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.399554:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.399588:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:2.0:1788201311.399591:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201311.399595:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1400, rc 0) 00000100:00100000:2.0:1788201311.399656:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+64:11401:x1875064662324224:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 353us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.399663:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:3.0:1788201311.413447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.413632:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662324480 00000100:00100000:1.0:1788201311.413645:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662324480 00000100:00100000:1.0:1788201311.413729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:1.0:1788201311.413791:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+64:11401:x1875064662324480:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201311.413905:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.413940:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.413955:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201311.414176:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1788201311.414243:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba84a8c8 reply state 0000000003784d9b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.414260:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.414268:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:1.0:1788201311.414271:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788201311.414275:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201311.414410:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+66:11401:x1875064662324480:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 670us (975us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788201311.414419:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 131 00010000:00010000:0.0:1788201311.414959:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201311.416882:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.417131:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662324608 00000100:00100000:3.0:1788201311.417147:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662324608 00000100:00100000:3.0:1788201311.417340:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:3.0:1788201311.417353:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+66:11401:x1875064662324608:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201311.417384:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201311.417410:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1c3 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.417514:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 67 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.417529:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 67 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.417550:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:3.0:1788201311.417553:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201311.417557:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201311.417641:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+67:11401:x1875064662324608:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 287us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.417649:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:2.0:1788201311.432016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.432128:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662324736 00000100:00100000:1.0:1788201311.432141:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662324736 00000100:00100000:1.0:1788201311.432249:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:1.0:1788201311.432261:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662324736:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788201311.432561:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662324736:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 302us (559us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788201311.432570:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:1.0:1788201311.443047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.446244:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662324992 00000100:00100000:2.0:1788201311.446261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662324992 00000100:00100000:2.0:1788201311.446830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1788201311.446844:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+67:11401:x1875064662324992:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788201311.447867:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+68:11401:x1875064662324992:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 1022us (4830us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788201311.447877:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:3.0:1788201311.454245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.454368:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662325248 00000100:00100000:2.0:1788201311.454381:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662325248 00000100:00100000:2.0:1788201311.454504:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:2.0:1788201311.454517:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+68:11401:x1875064662325248:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788201311.454676:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+68:11401:x1875064662325248:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 161us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.454684:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:3.0:1788201311.461254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.461435:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662325376 00000100:00100000:2.0:1788201311.461447:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662325376 00000100:00100000:2.0:1788201311.461547:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:2.0:1788201311.461564:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+68:11401:x1875064662325376:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201311.461590:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.461616:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1ca expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.461707:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.461777:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.461794:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201311.461849:0:10723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201311.461872:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.461903:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720b91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1ca expref: 70 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.461937:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1ca expref: 69 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.461948:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:2.0:1788201311.461951:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788201311.461955:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1e00, rc 0) 00000100:00100000:2.0:1788201311.462034:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+69:11401:x1875064662325376:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 472us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.462052:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:3.0:1788201311.465297:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.465975:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662325504 00000100:00100000:1.0:1788201311.465991:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662325504 00000100:00100000:1.0:1788201311.466106:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:1.0:1788201311.466119:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0c1d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662325504:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201311.466146:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201311.466186:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1d1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201311.466218:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c95e, blocks: 0x0 00010000:00010000:1.0:1788201311.466246:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1788201311.466252:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.466264:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.466286:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.466303:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255a00, rc 0) 00000100:00100000:1.0:1788201311.466381:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0c1d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662325504:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 264us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.466409:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:3.0:1788201311.472462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.472669:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662325760 00000100:00100000:2.0:1788201311.472682:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662325760 00000100:00100000:2.0:1788201311.472778:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:2.0:1788201311.472790:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+69:11401:x1875064662325760:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788201311.472943:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+69:11401:x1875064662325760:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 154us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.472952:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:3.0:1788201311.478698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.479859:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662325888 00000100:00100000:1.0:1788201311.479875:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662325888 00000100:00100000:1.0:1788201311.480049:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:1.0:1788201311.480062:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:11401:x1875064662325888:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201311.480089:0:8485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201311.480112:0:8485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1d8 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.480152:0:8485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.480173:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.480178:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.480183:0:8485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 9 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.480230:0:8485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.480245:0:8485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 9 pid: 8430 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.480262:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8485:1875064681271808:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201311.480404:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201311.489471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.489690:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662326016 00000100:00100000:2.0:1788201311.489703:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662326016 00010000:00010000:2.0:1788201311.490093:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 10 pid: 8430 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.490252:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00100000:2.0:1788201311.490267:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+10:2399:x1875064662326016:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201311.490289:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201311.490316:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 10 pid: 8430 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.490333:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 10 pid: 8430 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.490368:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201311.490374:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201311.490384:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 10 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.490416:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 10 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.490467:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 10 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.490484:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1875064681271936:192.168.203.2@tcp:105: 00000100:00100000:2.0:1788201311.490611:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa600 going to sleep for 11 seconds 00010000:00010000:1.0:1788201311.491368:0:8485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddca18c8/0xf9b71aee44720b9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d1 expref: 10 pid: 8430 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.491402:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8485:1875064681271808:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201311.491439:0:8485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 9 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.491455:0:8485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:0.0:1788201311.491576:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+9:11401:x1875064662325888:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 11514us (12890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.491587:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:3.0:1788201311.496520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.497468:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662326144 00000100:00100000:2.0:1788201311.497484:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662326144 00002000:00100000:2.0:1788201311.497555:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9cdf83666680 x1875064662326144/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:432/0 lens 504/0 e 0 to 0 dl 1788201322 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201311.497568:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf83666680 with x1875064662326144 ext(0->12) 00002000:00010000:2.0:1788201311.497575:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf83666680 00000100:00100000:2.0:1788201311.497616:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1788201311.497638:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2398:x1875064662326144:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788201311.499176:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1875064681271936:192.168.203.2@tcp:105: 00010000:00010000:1.0:1788201311.499213:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201311.499265:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2398:x1875064662326144:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 Request processed in 1636us (2756us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788201311.499277:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00002000:00100000:2.0:1788201311.499291:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9cdf83666680 x1875064662326144/t4294967310(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:432/0 lens 504/448 e 0 to 0 dl 1788201322 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201311.499315:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2399:x1875064662326016:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9049us (9858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.499326:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 74 00002000:00100000:2.0:1788201311.499388:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf83666680 with x1875064662326144 ext(0->12) 00002000:00010000:2.0:1788201311.499395:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf83666680 00000100:00100000:2.0:1788201311.501992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.502474:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662326272 00000100:00100000:1.0:1788201311.502485:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662326272 00000100:00100000:1.0:1788201311.502561:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:1.0:1788201311.502574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+69:11401:x1875064662326272:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788201311.504930:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788201311.504983:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788201311.505296:0:6495:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce0ba3b7840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788201311.505302:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0c1ffa600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce0ba3b7cc0 00000020:00080000:3.0:1788201311.505306:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0c1ffad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cdf8363d200 00000004:00080000:3.0:1788201311.505349:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788201311.505406:0:6495:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce08340ac00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788201311.505410:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cdf833a5000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce08340a180 00000020:00080000:3.0:1788201311.505413:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cdf833a5400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ce0b94f2600 00000020:00080000:3.0:1788201311.505430:0:6495:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:2.0:1788201311.505637:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505658:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505667:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505674:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.505680:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505689:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505711:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cdf81939d00) 00010000:00010000:2.0:1788201311.505715:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.505720:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505727:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447208ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505804:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505811:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505817:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505833:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.505838:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505845:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505854:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cdf8193a500) 00010000:00010000:2.0:1788201311.505857:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.505860:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505866:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720953 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505884:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505891:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505898:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505903:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.505906:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505924:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505945:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc800) 00010000:00010000:2.0:1788201311.505948:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.505951:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505958:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447209d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505971:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505977:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505983:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505988:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.505991:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.505997:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506005:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ce0866cc800) 00010000:00010000:2.0:1788201311.506008:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.506011:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506016:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447209f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506042:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506049:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506055:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506060:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.506064:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506070:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506078:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.506080:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.506083:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506088:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ac6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506099:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506105:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506111:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506122:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.506126:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506132:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506142:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:2.0:1788201311.506144:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201311.506147:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.506153:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720b83 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.506191:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681272064:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201311.506546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201311.506791:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201311.506801:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681272192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201311.506847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.507088:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681272064 00000100:00100000:3.0:1788201311.507099:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681272064 00000100:00100000:3.0:1788201311.507161:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681272192 00000100:00100000:3.0:1788201311.507165:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681272192 00000100:00100000:3.0:1788201311.507189:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201311.507200:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681272064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201311.507235:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1788201311.507264:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.507290:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.507301:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788201311.507307:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201311.507312:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.507346:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.507363:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 9 pid: 8432 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.507391:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83666d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875064681272320:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201311.507471:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.507680:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201311.507690:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681272192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201311.507708:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1788201311.507767:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a95c95e, atime: 0x6a95c95e, ctime: 0x6a95c95e, blocks: 0x8 00010000:00010000:0.0:1788201311.507774:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.507785:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1788201311.507788:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201311.507794:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.507808:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.507818:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.507837:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.507855:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201311.508059:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681272192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 370us (1210us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788201311.508067:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1788201311.508134:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ce0bf680e00/2, rc 0, transno 4294967305 00000100:00100000:0.0:1788201311.508142:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681272192:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788201311.508234:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788201311.508288:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788201311.508413:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+16:11401:x1875064662326272:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 5840us (6434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.508423:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 136 00010000:00010000:3.0:1788201311.509271:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201311.509282:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.509297:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201311.509302:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.509313:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.509337:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.509345:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ed2e7ee/0xf9b71aee44720bb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.509385:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.509388:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.509390:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201311.513920:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83666d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875064681272320:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201311.513960:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.515964:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.515999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201311.516103:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662326400 00000100:00100000:0.0:1788201311.516113:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662326400 00000100:00100000:0.0:1788201311.516181:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:0.0:1788201311.516192:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+10:2399:x1875064662326400:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788201311.517024:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662326528 00000100:00100000:2.0:1788201311.517032:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662326528 00010000:00010000:2.0:1788201311.517071:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 11 pid: 8432 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.517154:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:2.0:1788201311.517162:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2399:x1875064662326528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201311.517178:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201311.517184:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 11 pid: 8432 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.517222:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 11 pid: 8432 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.517251:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012f1326b/0xf9b71aee44720961 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc130 expref: 11 pid: 8432 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.517270:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201311.517274:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201311.517282:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.517292:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.517327:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201311.517392:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+10:2399:x1875064662326528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 231us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.517400:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 75 00010000:00010000:3.0:1788201311.517628:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.517640:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.517660:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.517669:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.517692:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201311.517906:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681272064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10706us (11359us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788201311.517923:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1788201311.517990:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.517999:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.518022:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201311.518027:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.518038:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.518053:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.518061:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f3575c/0xf9b71aee44720bad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.518081:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.518082:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.518084:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201311.518851:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788201311.518861:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788201311.518891:0:3646:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9cdf83665180 x1875064681272064/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201327 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788201311.518905:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf83665180/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788201311.518928:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681272064:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788201311.522213:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788201311.522232:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1788201311.522448:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662326400:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 6249us (6486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.522461:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:3.0:1788201311.525376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201311.525437:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662326784 00000100:00100000:0.0:1788201311.525449:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662326784 00000100:00100000:0.0:1788201311.525522:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:0.0:1788201311.525616:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+16:11401:x1875064662326784:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788201311.525690:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201311.525725:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44720b98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1ca expref: 16 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.525769:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:0.0:1788201311.525775:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201311.525814:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.525831:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.525843:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201311.526445:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f32b0c61 reply state 0000000011767c8f transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.526462:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.526470:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:0.0:1788201311.526473:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201311.526476:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201311.527389:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+17:11401:x1875064662326784:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 1851us (2019us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1788201311.527400:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:0.0:1788201311.530162:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.530266:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662326912 00000100:00100000:1.0:1788201311.530280:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662326912 00000100:00100000:1.0:1788201311.530349:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:1.0:1788201311.530378:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662326912:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788201311.530568:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788201311.530573:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788201310 00002000:00010000:1.0:1788201311.530576:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788201310 00002000:00010000:1.0:1788201311.530578:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788201310 -> 1788201310 00002000:00010000:1.0:1788201311.530581:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788201311.530874:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662326912:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 497us (724us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788201311.530883:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:1.0:1788201311.532413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.532472:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662327168 00000100:00100000:3.0:1788201311.532481:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662327168 00000100:00100000:3.0:1788201311.532557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:3.0:1788201311.532568:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+17:11401:x1875064662327168:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788201311.532676:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.532702:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.532711:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.532798:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.532814:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 17 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.532830:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681272448:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201311.533004:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201311.535106:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681272448:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201311.535144:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.535179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.535243:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662327296 00000100:00100000:2.0:1788201311.535251:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662327296 00010000:00010000:2.0:1788201311.535293:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 18 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.535335:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:2.0:1788201311.535346:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+18:2399:x1875064662327296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201311.535382:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201311.535391:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 18 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.535404:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 18 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.535430:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720b7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1bc expref: 18 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.535634:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:2.0:1788201311.535641:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.535652:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.535661:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.535723:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201311.535820:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+17:2399:x1875064662327296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 475us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.535828:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 76 00010000:00010000:3.0:1788201311.536042:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.536051:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.536101:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.536122:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.536129:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.536137:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201311.536142:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.536150:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.536223:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:3.0:1788201311.536227:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788201311.536232:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.536239:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bc2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.536339:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+16:11401:x1875064662327168:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 Request processed in 3772us (3930us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788201311.536348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:1.0:1788201311.537856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.537954:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662327424 00000100:00100000:3.0:1788201311.537964:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662327424 00000100:00100000:3.0:1788201311.538017:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:3.0:1788201311.538029:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662327424:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788201311.538083:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.538121:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.538131:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201311.538136:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201311.538141:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.538191:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.538206:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 7 pid: 8485 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.538224:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875064681272576:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201311.538317:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.543013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.543695:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875064681272576:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201311.543732:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.543936:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662327552 00000100:00100000:1.0:1788201311.543945:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662327552 00010000:00010000:1.0:1788201311.543990:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 8 pid: 8485 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.544030:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:1.0:1788201311.544040:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662327552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201311.544059:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201311.544084:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 8 pid: 8485 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.545132:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 8 pid: 8485 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.545380:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c14d9b0c/0xf9b71aee44720ba6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1d8 expref: 8 pid: 8485 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.545399:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201311.545405:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201311.545416:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.545428:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.545607:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201311.545679:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662327552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1638us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.545689:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 77 00010000:00010000:3.0:1788201311.545785:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.545795:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.545833:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.545841:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.545850:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.545858:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bae00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201311.545863:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.545873:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.545887:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.545896:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007146c84b/0xf9b71aee44720bc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.546020:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662327424:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 7992us (8172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.546029:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:2.0:1788201311.547733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201311.547799:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662327808 00000100:00100000:1.0:1788201311.547811:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662327808 00000100:00100000:2.0:1788201311.548082:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:2.0:1788201311.548097:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+16:11401:x1875064662327808:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788201311.548196:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.548217:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.548285:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.548326:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.548340:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 16 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.548356:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681272704:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201311.548491:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.551070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.551396:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662327936 00000100:00100000:3.0:1788201311.551407:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662327936 00010000:00010000:3.0:1788201311.551450:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 17 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.551500:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:3.0:1788201311.551509:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+17:2398:x1875064662327936:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201311.551524:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201311.551530:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 17 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.551543:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 17 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.551571:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:3.0:1788201311.551577:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 17 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.551598:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.551608:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.551617:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.551640:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201311.551850:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720abf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc184 expref: 17 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.551869:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681272704:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201311.551893:0:8476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.551903:0:8476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.551928:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.552029:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+16:2398:x1875064662327936:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 519us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.552038:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 78 00010000:00010000:2.0:1788201311.552147:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.552231:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 16 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.552241:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.552275:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 16 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.552289:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 16 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.552304:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681272832:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201311.552365:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.554249:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681272832:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201311.554274:0:8476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201311.554372:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.554503:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662328064 00000100:00100000:2.0:1788201311.554512:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662328064 00010000:00010000:2.0:1788201311.554560:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 17 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.554622:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:2.0:1788201311.554633:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+17:2398:x1875064662328064:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201311.554650:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201311.554658:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 17 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.554670:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 17 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.554696:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720b8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1c3 expref: 17 pid: 8476 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.554940:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:2.0:1788201311.554946:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.554957:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.554964:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.554994:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201311.555012:0:8476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.555027:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.555047:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+16:2398:x1875064662328064:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 416us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.555054:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 79 00000001:00080000:3.0:1788201311.555166:0:8476:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1788201311.555307:0:8476:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1788201311.555351:0:8476:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788201311.555487:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8476:1875064681272960:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788201311.555544:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.555680:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681272960 00000100:00100000:2.0:1788201311.555693:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681272960 00000100:00100000:2.0:1788201311.555812:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201311.555820:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8476:x1875064681272960:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788201311.555903:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8476:x1875064681272960:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.555920:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788201311.555948:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201311.555972:0:8476:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788201311.555977:0:8476:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf83665180, transno 4294967311 00000100:00100000:3.0:1788201311.555998:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8476:1875064681272960:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788201311.556119:0:8476:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1788201311.556159:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8476:1875064681273088:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788201311.556208:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.556277:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201311.556315:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681273088 00000100:00100000:1.0:1788201311.556321:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681273088 00000100:00100000:1.0:1788201311.556354:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788201311.556362:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8476:x1875064681273088:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201311.556514:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8476:x1875064681273088:12345-0@lo:1000:mdt00_003.0 Request processed in 152us (305us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788201311.556522:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788201311.556940:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0834cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8476:1875064681273088:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788201311.557050:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557060:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557069:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557077:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.557082:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557090:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557107:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:2.0:1788201311.557110:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201311.557115:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557122:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720bd7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557148:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557238:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557243:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557248:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.557251:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557257:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557266:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.557269:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201311.557276:0:8476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 19 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557289:0:8476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 19 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557299:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 19 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.557335:0:8476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 19 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.557349:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681273216:192.168.203.2@tcp:105: 00000100:00100000:2.0:1788201311.557488:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.559946:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8476:1875064681273216:192.168.203.2@tcp:105: 00010000:00010000:2.0:1788201311.559982:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.559994:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720b1a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560035:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560053:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560067:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560080:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560086:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560093:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560099:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.560103:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560110:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560147:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.560150:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.560154:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201311.560418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.560618:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662328192 00000100:00100000:3.0:1788201311.560628:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662328192 00010000:00010000:2.0:1788201311.560788:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720bde lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560806:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560813:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560820:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560827:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.560831:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560838:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560849:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.560852:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201311.560855:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.560862:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720bd0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.561013:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:3.0:1788201311.561025:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+20:11400:x1875064662328192:12345-192.168.203.2@tcp:49:lfs.0 00000100:00100000:2.0:1788201311.561083:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+20:11401:x1875064662327808:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 12990us (13361us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788201311.561093:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 139 00000020:00080000:2.0:1788201311.561098:0:8476:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788201311.561128:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+19:11400:x1875064662328192:12345-192.168.203.2@tcp:49:lfs.0 Request processed in 106us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.561134:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000040:00080000:1.0:1788201311.561246:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201311.561252:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201311.561853:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788201311.561863:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788201311.562951:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.563074:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662328576 00000100:00100000:3.0:1788201311.563099:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662328576 00000100:00100000:1.0:1788201311.563130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201311.563214:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662328704 00000100:00100000:0.0:1788201311.563218:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662328704 00000100:00100000:3.0:1788201311.563257:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:3.0:1788201311.563269:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+20:11400:x1875064662328576:12345-192.168.203.2@tcp:58:lfs.0 00000100:00100000:0.0:1788201311.563287:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:0.0:1788201311.563294:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf43450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+20:11401:x1875064662328704:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1788201311.563457:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788201311.563529:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11400:x1875064662328576:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 263us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.563536:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 140 00000004:00080000:0.0:1788201311.563547:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788201311.563829:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788201311.563867:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.563883:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.563904:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.563921:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.563928:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.563935:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.563993:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.564055:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201311.564061:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf43450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11401:x1875064662328704:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 767us (930us total) trans 4294967410 rc 0/0 00010000:00010000:1.0:1788201311.564063:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201311.564067:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00010000:00010000:1.0:1788201311.564071:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367cc00 already unused, calling callback (ffffffffc0f1dfe0) 00000020:00080000:0.0:1788201311.564072:0:6518:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788201311.564076:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.564084:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.564098:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:1.0:1788201311.564102:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201311.564107:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.564114:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720be5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.564130:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.564132:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.564134:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201311.588093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.588269:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662328832 00000100:00100000:3.0:1788201311.588282:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662328832 00000100:00100000:3.0:1788201311.588385:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:3.0:1788201311.588398:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+21:11403:x1875064662328832:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201311.588435:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201311.588462:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720bec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1df expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588545:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588573:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588595:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588614:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588623:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588663:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588782:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588794:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588802:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588845:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.588861:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 22 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.588878:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681273344:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201311.589003:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.592196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201311.592719:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681273344:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201311.592775:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.593788:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662329088 00000100:00100000:1.0:1788201311.593801:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662329088 00000100:00100000:1.0:1788201311.593869:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1788201311.593880:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+23:6168:x1875064662329088:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788201311.594203:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+24:6168:x1875064662329088:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 323us (2019us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788201311.594232:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1788201311.599818:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201311.599983:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662329216 00000100:00100000:2.0:1788201311.599997:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662329216 00010000:00010000:2.0:1788201311.600047:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 24 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.600092:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:2.0:1788201311.600104:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+24:2399:x1875064662329216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201311.600124:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201311.600132:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 24 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.600152:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 24 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.600179:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720b0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a0 expref: 24 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.600200:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.600205:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.600282:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.600310:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.600392:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201311.600469:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+23:2399:x1875064662329216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 366us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.600477:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 80 00010000:00010000:3.0:1788201311.601263:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.601276:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201311.601530:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788201311.601536:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201311.601562:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601578:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601589:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601596:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601604:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601610:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.601614:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601621:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601645:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201311.601647:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.601651:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601658:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720bf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601674:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601680:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601685:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601690:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201311.601692:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601697:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601702:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cdf8193a800) 00010000:00010000:2.0:1788201311.601704:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201311.601715:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601720:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720bfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601792:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720bec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1df expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601812:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1df expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.601820:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201311.601822:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201311.601824:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb200, rc 0) 00000100:00100000:2.0:1788201311.601872:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+22:11403:x1875064662328832:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13477us (13794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.601880:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 141 00000040:00080000:1.0:1788201312.425875:0:14309:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201312.425888:0:14309:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201312.425943:0:14309:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788201312.425951:0:14309:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788201312.440700:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201312.568592:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201312.568601:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201312.568639:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788201312.568646:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201312.568804:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681273472:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788201312.568893:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201312.580370:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201312.580392:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681273472:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788201312.580402:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662329344 00000100:00100000:3.0:1788201312.580411:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662329344 00000100:00100000:3.0:1788201312.580477:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:3.0:1788201312.580490:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+22:11415:x1875064662329344:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1788201312.580769:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1788201312.582051:0:8476:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788201312.584782:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+22:11415:x1875064662329344:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 4286us (4412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201312.584797:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:2.0:1788201312.593147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201312.593491:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662329600 00000100:00100000:1.0:1788201312.593500:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662329600 00000100:00100000:1.0:1788201312.593557:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:1.0:1788201312.593575:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+22:11415:x1875064662329600:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201312.593595:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201312.593614:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720c08 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201312.593723:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720c0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201312.593760:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720c0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201312.593780:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720c0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201312.593793:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788201312.593899:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720c08 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1e6 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201312.593930:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720c0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1e6 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201312.593939:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:1.0:1788201312.593943:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201312.593946:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255e00, rc 0) 00000100:00100000:1.0:1788201312.594003:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+24:11415:x1875064662329600:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 429us (861us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788201312.594011:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:0.0:1788201312.602815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201312.602925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201312.602962:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662329984 00000100:00100000:0.0:1788201312.602972:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662329984 00000100:00100000:0.0:1788201312.603033:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:0.0:1788201312.603044:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+24:11415:x1875064662329984:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788201312.603168:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662329728 00000100:00100000:1.0:1788201312.603173:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662329728 00000100:00100000:1.0:1788201312.603207:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:1.0:1788201312.603214:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+25:2398:x1875064662329728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201312.603226:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201312.603249:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720c0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1e6 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201312.603268:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:1.0:1788201312.603285:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201312.603360:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+24:2398:x1875064662329728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 145us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.603368:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00010000:00010000:0.0:1788201312.603649:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603664:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603687:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603867:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603875:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603883:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603889:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201312.603894:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603911:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603924:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:0.0:1788201312.603926:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201312.603930:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201312.603937:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44720c1d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201312.604043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+24:11415:x1875064662329984:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 1001us (1118us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788201312.604052:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000040:00080000:2.0:1788201312.606073:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201312.606083:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201312.607426:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788201312.607445:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201312.612529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201312.612786:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662330240 00000100:00100000:2.0:1788201312.612795:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662330240 00000100:00100000:2.0:1788201312.612852:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:2.0:1788201312.612862:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+24:11415:x1875064662330240:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788201312.613091:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+25:11415:x1875064662330240:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 229us (570us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788201312.613100:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:1.0:1788201312.889647:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201312.889675:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681273600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201312.889766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201312.889829:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681273728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.889840:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681273856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.889866:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201312.889931:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681273728 00000100:00100000:1.0:1788201312.889939:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681273728 00000100:00100000:1.0:1788201312.889987:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788201312.889998:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681273728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.890008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201312.890107:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681273600 00000100:00100000:0.0:1788201312.890114:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681273600 00000100:00100000:0.0:1788201312.890163:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788201312.890171:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681273600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201312.890194:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201312.893113:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681273728:12345-0@lo:400:kworker.0 Request processed in 3097us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.893129:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788201312.893219:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681273728:0@lo:400:kworker.0 00000100:00080000:1.0:1788201312.893277:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201312.893371:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681273984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.893410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201312.893461:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681273984 00000100:00100000:1.0:1788201312.893468:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681273984 00000100:00100000:1.0:1788201312.893583:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201312.893593:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681273984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.893645:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681273984:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.893677:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201312.893706:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681273984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201312.894728:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681273856 00000100:00100000:0.0:1788201312.894759:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681273856 00000100:00100000:0.0:1788201312.894821:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788201312.894836:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681273856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.894917:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681273600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4745us (5150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.894927:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788201312.895032:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681273856:12345-0@lo:400:kworker.0 Request processed in 200us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201312.895040:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788201312.895167:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681273856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.895270:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681273600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201312.901116:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681274240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.901230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201312.901341:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681274240 00000100:00100000:0.0:1788201312.901351:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681274240 00000100:00100000:0.0:1788201312.901420:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201312.901431:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681274240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201312.902064:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681274112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201312.902116:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201312.902482:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681274112 00000100:00100000:3.0:1788201312.902489:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681274112 00000100:00100000:2.0:1788201312.902852:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201312.902867:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681274368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.903199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201312.903268:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681274496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.903302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201312.903331:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681274368 00000100:00100000:2.0:1788201312.903336:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681274368 00000100:00100000:3.0:1788201312.903407:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788201312.903423:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681274112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201312.903485:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681274112:12345-0@lo:400:kworker.0 Request processed in 66us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.903520:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681274240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.903581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681274496 00000100:00100000:1.0:1788201312.903585:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681274496 00000100:00100000:0.0:1788201312.904054:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681274240:12345-0@lo:400:kworker.0 Request processed in 2618us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201312.904065:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1788201312.904109:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201312.904114:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201312.905036:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788201312.905062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788201312.905080:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681274368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.905087:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788201312.905101:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681274496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.905177:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681274368:12345-0@lo:400:kworker.0 Request processed in 106us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201312.905184:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788201312.905309:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681274112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.905438:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681274496:12345-0@lo:400:kworker.0 Request processed in 342us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.905445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788201312.905471:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf83710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681274752:0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.905513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201312.905553:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201312.905561:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681274624:0@lo:400:kworker.0 00010000:00080000:2.0:1788201312.905579:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf595500 x1875064681274496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201312.905597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201312.905624:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681274752 00000100:00100000:1.0:1788201312.905632:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681274624 00000100:00100000:0.0:1788201312.905633:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681274752 00000100:00100000:1.0:1788201312.905640:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681274624 00000100:00100000:2.0:1788201312.905653:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681274496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.905685:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681274368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.905702:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201312.905709:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681274880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.905763:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201312.905790:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681274880 00000100:00100000:2.0:1788201312.905794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681274880 00000100:00100000:2.0:1788201312.905828:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788201312.905854:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681274880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.905892:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875064681274880:12345-0@lo:400:kworker.0 Request processed in 38us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201312.905898:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788201312.905940:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681275008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.905971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201312.906000:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875064681274880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.906021:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681275008 00000100:00100000:2.0:1788201312.906024:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681275008 00000100:00100000:2.0:1788201312.906049:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788201312.906056:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681275008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.906090:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681275008:12345-0@lo:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201312.906096:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:2.0:1788201312.906118:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b94c7480 x1875064681275008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201312.906127:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681275008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.906147:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681275136:0@lo:400:kworker.0 00000100:00100000:2.0:1788201312.906172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201312.913693:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681275136 00000100:00100000:1.0:1788201312.913712:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681275136 00000100:00100000:1.0:1788201312.913847:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788201312.913859:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681274624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.913973:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681274624:12345-0@lo:400:kworker.0 Request processed in 117us (8376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.913982:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788201312.914001:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201312.914008:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681274752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.914039:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681274752:12345-0@lo:400:kworker.0 Request processed in 31us (8526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.914044:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201312.914056:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788201312.914063:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681275136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.914100:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681275136:12345-0@lo:400:kworker.0 Request processed in 38us (7927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201312.914105:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788201312.914442:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681274624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201312.914459:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf83710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681274752:0@lo:400:kworker.0 00000100:00080000:1.0:1788201312.914524:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201312.914529:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201312.914533:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201312.914548:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201312.915041:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681275136:0@lo:400:kworker.0 00000100:00100000:1.0:1788201313.398623:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681275264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201313.398732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.399075:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681275264 00000100:00100000:2.0:1788201313.399086:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681275264 00000100:00100000:2.0:1788201313.399347:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201313.399361:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681275264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201313.399396:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201313.399509:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681275264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.399546:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788201313.399869:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681275264:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201313.462086:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201313.480447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201313.480505:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201313.480560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201313.480597:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201313.480619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201313.480643:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201313.480673:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662330368 00000100:00100000:1.0:1788201313.480675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201313.480688:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662330368 00000100:00100000:1.0:1788201313.480786:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662330496 00000100:00100000:1.0:1788201313.480792:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662330496 00000100:00100000:2.0:1788201313.480793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 381 00000100:00100000:2.0:1788201313.480809:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662330368:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201313.480837:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662331008 00000100:00100000:1.0:1788201313.480841:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662331008 00000100:00100000:1.0:1788201313.480872:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662330624 00000100:00100000:1.0:1788201313.480875:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662330624 00000100:00100000:1.0:1788201313.480891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 288 00000100:00100000:1.0:1788201313.480911:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+25:2400:x1875064662330496:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201313.480919:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662330368:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 111us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.480929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 381 00000100:00100000:1.0:1788201313.480962:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+25:2400:x1875064662330496:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 63us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201313.480970:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 288 00000100:00100000:2.0:1788201313.480973:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662331136 00000100:00100000:2.0:1788201313.480979:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662331136 00000100:00100000:1.0:1788201313.480990:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 289 00000100:00100000:1.0:1788201313.480998:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662331008:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201313.481021:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 290 00000100:00100000:1.0:1788201313.481030:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662331008:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 31us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.481033:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662330624:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201313.481042:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 289 00000100:00100000:1.0:1788201313.481060:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 291 00000100:00100000:1.0:1788201313.481068:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662331136:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201313.481074:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2400:x1875064662330624:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 45us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.481082:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 290 00000100:00100000:1.0:1788201313.481100:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662331136:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201313.481106:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 291 00000100:00100000:2.0:1788201313.481127:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662330752 00000100:00100000:2.0:1788201313.481133:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662330752 00000100:00080000:1.0:1788201313.481142:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201313.481149:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201313.481154:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201313.481166:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662330880 00000100:00100000:2.0:1788201313.481169:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662330880 00000100:00100000:2.0:1788201313.481191:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1788201313.481197:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662330752:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201313.481240:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662330752:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.481246:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1788201313.481257:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:2.0:1788201313.481270:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662330880:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201313.481303:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662330880:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.481308:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00080000:1.0:1788201313.481824:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788201314.349106:0:14360:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788201314.349115:0:14360:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788201314.349229:0:14360:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788201314.349238:0:14360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788201314.489460:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201314.518045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201314.518122:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662331392 00000100:00100000:2.0:1788201314.518136:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662331392 00000100:00100000:2.0:1788201314.518227:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:2.0:1788201314.518241:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+25:11435:x1875064662331392:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201314.518272:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788201314.518293:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201314.518312:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720c24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1ed expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.518470:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720c2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.518489:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720c2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.518504:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720c2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201314.518525:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788201314.518831:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720c24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1ed expref: 28 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.518846:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720c2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1ed expref: 27 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.518866:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201314.518869:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788201314.518872:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1600, rc 0) 00000100:00100000:2.0:1788201314.518965:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+27:11435:x1875064662331392:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 728us (936us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788201314.518975:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:1.0:1788201314.522641:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201314.522716:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662331520 00000100:00100000:2.0:1788201314.522729:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662331520 00000100:00100000:2.0:1788201314.522821:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:2.0:1788201314.522833:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+27:11435:x1875064662331520:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:2.0:1788201314.522935:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.522956:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.522970:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.523020:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.523029:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.523036:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.523043:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201314.523056:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.523064:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.523088:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201314.523092:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201314.523098:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.523105:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1c00/0xf9b71aee44720c39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201314.523648:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+27:11435:x1875064662331520:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 813us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201314.523659:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:1.0:1788201314.606791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201314.606985:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662331648 00000100:00100000:2.0:1788201314.606998:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662331648 00000100:00100000:2.0:1788201314.607066:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:2.0:1788201314.607077:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662331648:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1788201314.607101:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201314.607127:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44720c40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1f4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201314.607161:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a95c95e, atime: 0x6a95c95e, ctime: 0x6a95c95e, blocks: 0x8 00010000:00010000:2.0:1788201314.607190:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788201314.607195:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201314.607208:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44720c40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1f4 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.607252:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44720c40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1f4 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.607269:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1c00, rc 0) 00000100:00100000:2.0:1788201314.607512:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662331648:12345-192.168.203.2@tcp:101:cat.0 Request processed in 427us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201314.607520:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:3.0:1788201314.611513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201314.612464:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662331776 00000100:00100000:1.0:1788201314.612477:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662331776 00002000:00100000:1.0:1788201314.612555:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9ce0b94c7480 x1875064662331776/t0(0) o3->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:435/0 lens 488/0 e 0 to 0 dl 1788201325 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201314.612582:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ce0b94c7480 with x1875064662331776 ext(0->4095) 00002000:00010000:1.0:1788201314.612590:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ce0b94c7480 00000100:00100000:1.0:1788201314.612633:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1788201314.612644:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662331776:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1788201314.613098:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662331776:12345-192.168.203.2@tcp:3:cat.0 Request processed in 453us (1599us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788201314.613108:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00002000:00100000:1.0:1788201314.613115:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9ce0b94c7480 x1875064662331776/t0(0) o3->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:435/0 lens 488/4536 e 0 to 0 dl 1788201325 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201314.613125:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ce0b94c7480 with x1875064662331776 ext(0->4095) 00002000:00010000:1.0:1788201314.613128:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ce0b94c7480 00000100:00100000:2.0:1788201314.937293:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201314.937325:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681275392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201314.937429:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201314.937874:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681275520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201314.937917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201314.939036:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681275392 00000100:00100000:1.0:1788201314.939053:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681275392 00000100:00100000:1.0:1788201314.939126:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681275520 00000100:00100000:1.0:1788201314.939130:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681275520 00000100:00100000:1.0:1788201314.939174:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788201314.939186:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681275392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201314.939237:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788201314.939448:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681275392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 263us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.939458:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788201314.939486:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201314.939495:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681275520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201314.939516:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788201314.939553:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681275520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.939560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788201314.940806:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681275392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201314.940852:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681275520:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1788201315.446924:0:8483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395744181729ns, next at 396744178027ns, rc = 0 00000100:00100000:0.0:1788201315.448113:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681275648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201315.448223:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201315.448297:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201315.448306:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681275776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201315.448330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201315.448456:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681275648 00000100:00100000:3.0:1788201315.448467:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681275648 00000100:00100000:3.0:1788201315.448526:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681275776 00000100:00100000:3.0:1788201315.448529:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681275776 00000100:00100000:3.0:1788201315.448549:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201315.448560:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681275648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201315.448608:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788201315.448660:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681275648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201315.448668:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201315.448687:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201315.448694:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681275776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201315.448704:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788201315.448728:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681275776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201315.448734:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1788201315.448785:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201315.449041:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681275776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201315.449059:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681275648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201315.510277:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201316.488358:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788201316.488382:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:1.0:1788201316.540600:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201317.497144:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788201317.497379:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000004:00080000:2.0:1788201317.498049:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:0.0:1788201317.498337:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201317.498364:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681275904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788201317.498458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201317.498596:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681275904 00000100:00100000:1.0:1788201317.498606:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681275904 00000100:00080000:0.0:1788201317.498981:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201317.499057:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201317.499072:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681275904:12345-0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1788201317.499349:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788201317.499387:0:6495:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce082bbd900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788201317.499391:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cdf835fac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce082bbd840 00000020:00080000:2.0:1788201317.499394:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cdf835fa600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cdf8350a800 00000020:00080000:2.0:1788201317.499414:0:6495:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788201317.499445:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788201317.499537:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00002000:00010000:1.0:1788201317.499653:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788201317.499657:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788201310 -> 1788201310 00002000:00010000:1.0:1788201317.499660:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788201310 -> 1788201310 00002000:00010000:1.0:1788201317.499662:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788201310 -> 1788201310 00010000:00010000:0.0:1788201317.500124:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201317.500137:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201317.500145:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201317.500152:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201317.500157:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201317.500243:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201317.500290:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ce0839b3300) 00010000:00010000:0.0:1788201317.500294:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201317.500301:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201317.500308:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720bbb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201317.500382:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788201317.500481:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681275904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1411us (2020us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788201317.500500:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201317.500598:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788201317.500606:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1788201317.500636:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9cdf82404a80 x1875064681275904/t4294967314(4294967314) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788201333 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788201317.500650:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf82404a80/2, rc 0, transno 4294967314 00000100:00100000:0.0:1788201317.500656:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681275904:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788201317.563005:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201318.006086:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681276416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.006242:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681276928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.006290:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681277440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.006340:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788201318.006367:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681276032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.006424:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681276544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.006464:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681277056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.006519:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681277568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.006573:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681276928 00000100:00100000:3.0:1788201318.006582:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681276928 00000100:00100000:3.0:1788201318.006654:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681277440 00000100:00100000:3.0:1788201318.006658:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681277440 00000100:00100000:3.0:1788201318.006674:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681277056 00000100:00100000:3.0:1788201318.006676:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681277056 00000100:00100000:3.0:1788201318.006690:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681277568 00000100:00100000:3.0:1788201318.006692:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681277568 00000100:00100000:3.0:1788201318.006707:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788201318.006717:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681276928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006804:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681276928:12345-0@lo:400:kworker.0 Request processed in 87us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.006812:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788201318.006831:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201318.006838:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681277440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006876:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681277440:12345-0@lo:400:kworker.0 Request processed in 39us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.006883:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201318.006895:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201318.006908:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681277056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006937:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681277056:12345-0@lo:400:kworker.0 Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.006944:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201318.006956:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201318.006962:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681277568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.006987:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681277568:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.006993:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201318.007014:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681276032 00000100:00100000:3.0:1788201318.007023:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681276032 00000100:00100000:3.0:1788201318.007056:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788201318.007063:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681276032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.007094:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681276032:12345-0@lo:400:kworker.0 Request processed in 32us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.007099:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788201318.007154:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681276032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.007170:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681277056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.007178:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788201318.007184:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1788201318.007221:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ce0bf680e00, transno 4294967305 00000100:00100000:3.0:1788201318.007232:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681277568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.007244:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681276928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.007253:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681277440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010028:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681276160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.010168:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681276672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.010213:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681277184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.010263:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788201318.010271:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681276288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.010322:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681276800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010345:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.010378:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681277312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010401:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.010437:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681276416 00000100:00100000:0.0:1788201318.010447:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681276416 00000100:00100000:0.0:1788201318.010492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681276160 00000100:00100000:0.0:1788201318.010495:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681276160 00000100:00100000:0.0:1788201318.010507:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681276672 00000100:00100000:0.0:1788201318.010510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681276672 00000100:00100000:0.0:1788201318.010545:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681277184 00000100:00100000:0.0:1788201318.010548:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681277184 00000100:00100000:0.0:1788201318.010562:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681276800 00000100:00100000:0.0:1788201318.010564:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681276800 00000100:00100000:0.0:1788201318.010576:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681277312 00000100:00100000:0.0:1788201318.010578:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681277312 00000100:00100000:0.0:1788201318.010594:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788201318.010603:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8372ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681276416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010670:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8372ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681276416:12345-0@lo:400:kworker.0 Request processed in 67us (4493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.010678:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788201318.010697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788201318.010703:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681276160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010735:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681276160:12345-0@lo:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.010763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788201318.010775:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788201318.010782:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681276672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.010807:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681276672:12345-0@lo:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.010821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788201318.010834:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788201318.011435:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788201318.011446:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681276800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.011494:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0834cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681276800:12345-0@lo:400:kworker.0 Request processed in 52us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.011501:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788201318.011516:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788201318.011522:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681277312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.011547:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681277312:12345-0@lo:400:kworker.0 Request processed in 26us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.011553:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1788201318.011696:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201318.011702:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201318.011706:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201318.011709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201318.011731:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681276544 00000100:00100000:1.0:1788201318.011761:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681276544 00000100:00100000:1.0:1788201318.011796:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681276288 00000100:00100000:1.0:1788201318.011799:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681276288 00000100:00100000:1.0:1788201318.011814:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788201318.011820:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681276544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.012121:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681277184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.012168:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681277184:12345-0@lo:400:kworker.0 Request processed in 1328us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.012174:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788201318.012209:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788201318.012218:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681276288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.012247:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681276288:12345-0@lo:400:kworker.0 Request processed in 31us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.012252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788201318.012302:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681276288:0@lo:400:kworker.0 00010000:00080000:0.0:1788201318.012319:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c0700 x1875064681276800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201318.012329:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681276800:0@lo:400:kworker.0 00010000:00080000:0.0:1788201318.012341:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf836cbb80 x1875064681277312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201318.012350:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681277312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.012362:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681276160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.012372:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681276672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.012382:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681277184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.012432:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681276416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.012724:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201318.012766:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8370fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681277696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201318.012811:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.014459:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681276544:12345-0@lo:400:kworker.0 Request processed in 2628us (7998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.014474:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788201318.014915:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681276544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.015250:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681277696 00000100:00100000:3.0:1788201318.015260:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681277696 00000100:00100000:3.0:1788201318.015322:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201318.015333:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681277696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201318.016002:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201318.016081:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681277696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 749us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.016088:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788201318.016225:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8370fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681277696:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788201318.201153:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201318.520264:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201318.520295:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8370ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681277824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201318.520390:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201318.522165:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681277824 00000100:00100000:2.0:1788201318.522182:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681277824 00000100:00100000:2.0:1788201318.522268:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788201318.522298:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681277824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201318.522333:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201318.522430:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681277824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.522438:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201318.524155:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8370ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681277824:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201318.583144:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201318.600665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201318.603010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201318.603046:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201318.603066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201318.603087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201318.603124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201318.603164:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662332160 00000100:00100000:3.0:1788201318.603178:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662332160 00000100:00100000:3.0:1788201318.603251:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662332672 00000100:00100000:3.0:1788201318.603254:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662332672 00000100:00100000:3.0:1788201318.603274:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662332032 00000100:00100000:3.0:1788201318.603277:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662332032 00000100:00100000:3.0:1788201318.603311:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 298 00000100:00100000:3.0:1788201318.603322:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662332160:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201318.603420:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662332160:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 98us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.603428:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 298 00000100:00100000:3.0:1788201318.603449:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 299 00000100:00100000:3.0:1788201318.603456:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662332672:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201318.603482:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662332672:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.603488:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 299 00000100:00100000:3.0:1788201318.603500:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 300 00000100:00100000:3.0:1788201318.603507:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+13:2399:x1875064662332032:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201318.603536:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+13:2399:x1875064662332032:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.603541:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 300 00000100:00100000:3.0:1788201318.603565:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662332416 00000100:00100000:2.0:1788201318.603565:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662331904 00000100:00100000:3.0:1788201318.603570:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662332416 00000100:00100000:2.0:1788201318.603573:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662331904 00000100:00100000:3.0:1788201318.603603:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662332288 00000100:00100000:3.0:1788201318.603607:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662332288 00000100:00100000:2.0:1788201318.603634:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 383 00000100:00100000:3.0:1788201318.603639:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:2.0:1788201318.603648:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662331904:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201318.603652:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662332416:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201318.603998:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662331904:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 353us (3346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.604008:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 383 00000100:00100000:3.0:1788201318.604128:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2399:x1875064662332416:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 479us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.604136:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:3.0:1788201318.604150:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:3.0:1788201318.604165:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662332288:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201318.604196:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2399:x1875064662332288:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 32us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.604202:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00080000:3.0:1788201318.604236:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201318.604242:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201318.604244:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201318.604247:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201318.605262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201318.605298:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662332544 00000100:00100000:2.0:1788201318.605308:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662332544 00000100:00100000:2.0:1788201318.605378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 301 00000100:00100000:2.0:1788201318.605390:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662332544:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201318.605591:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1faf6d77-706d-41b4-9836-f216205de0f1+5:2399:x1875064662332544:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 203us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.605601:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 301 00000100:00080000:3.0:1788201318.607176:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201318.756647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201318.756794:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662332800 00000100:00100000:3.0:1788201318.756807:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662332800 00000100:00100000:3.0:1788201318.756886:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 147 00000100:00100000:3.0:1788201318.756898:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+13:11081:x1875064662332800:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788201318.757100:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+13:11081:x1875064662332800:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 202us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.757109:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 147 00000100:00100000:2.0:1788201318.762966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201318.763145:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662332928 00000100:00100000:3.0:1788201318.763160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662332928 00000100:00100000:3.0:1788201318.763283:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 148 00000100:00100000:3.0:1788201318.763297:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:11081:x1875064662332928:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788201318.764646:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:11081:x1875064662332928:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 1339us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.764671:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 148 00000100:00100000:1.0:1788201318.768024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201318.768205:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662333184 00000100:00100000:0.0:1788201318.768217:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662333184 00000100:00100000:0.0:1788201318.768288:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:0.0:1788201318.768300:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+13:11081:x1875064662333184:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788201318.768635:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+14:11081:x1875064662333184:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 336us (627us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788201318.768643:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000040:00080000:3.0:1788201318.774063:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201318.774079:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201318.774126:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788201318.774138:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201319.032676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201319.032828:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662333312 00000100:00100000:2.0:1788201319.032841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662333312 00000100:00100000:2.0:1788201319.032935:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00100000:2.0:1788201319.032948:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:11895:x1875064662333312:12345-192.168.203.2@tcp:101:lsof.0 00010000:00010000:2.0:1788201319.032980:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201319.033029:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720c47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc1fb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.033122:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.033140:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.033158:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201319.033224:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201319.033229:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201319.033297:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.033334:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44720c47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.033356:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.033367:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:2.0:1788201319.033376:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201319.033380:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1400, rc 0) 00000100:00100000:2.0:1788201319.033467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+6:11895:x1875064662333312:12345-192.168.203.2@tcp:101:lsof.0 Request processed in 522us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.033476:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 149 00010000:00010000:1.0:1788201319.607005:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201320.055791:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201320.055818:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681277952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201320.055895:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201320.055908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201320.055921:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8370d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681278080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201320.055996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201320.056077:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681277952 00000100:00100000:3.0:1788201320.056088:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681277952 00000100:00100000:3.0:1788201320.056153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681278080 00000100:00100000:3.0:1788201320.056157:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681278080 00000100:00100000:2.0:1788201320.056187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788201320.056214:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788201320.056225:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681277952:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201320.056233:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681278080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201320.056277:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000004:00000024:2.0:1788201320.056277:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201320.056355:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681277952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.056363:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788201320.056446:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681278080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 219us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201320.056455:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788201320.056480:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681277952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201320.056552:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8370d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681278080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201320.566114:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681278208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201320.566229:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681278336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201320.566241:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201320.566696:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681278208 00000100:00100000:0.0:1788201320.566708:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681278208 00000100:00100000:0.0:1788201320.566824:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788201320.566838:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681278208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201320.566887:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788201320.566948:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681278208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201320.566956:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788201320.567139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201320.567305:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201320.567355:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681278208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201320.567874:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681278336 00000100:00100000:0.0:1788201320.567881:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681278336 00000100:00100000:0.0:1788201320.567937:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788201320.567946:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681278336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201320.567984:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788201320.568045:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681278336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201320.568052:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788201320.568391:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681278336:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201320.568589:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201320.634068:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201321.659490:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201322.171106:0:14557:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:35:20 (1788201320) 00010000:00010000:1.0:1788201322.678133:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201323.126300:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201323.126325:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8370e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681278464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201323.126394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201323.126581:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681278464 00000100:00100000:3.0:1788201323.126590:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681278464 00000100:00100000:3.0:1788201323.126656:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201323.126668:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681278464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201323.126702:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201323.126773:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681278464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201323.126780:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201323.126827:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8370e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681278464:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201323.126969:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201323.128965:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681278720:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.129035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.129086:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681279232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.129108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.129132:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681279744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.129156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.129178:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201323.129184:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681278848:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.129209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.129225:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681279360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.129259:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.129284:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681279872:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.129305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.129337:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681278720 00000100:00100000:2.0:1788201323.129342:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681278720 00000100:00100000:2.0:1788201323.129378:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681279232 00000100:00100000:2.0:1788201323.129381:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681279232 00000100:00100000:2.0:1788201323.129403:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681279744 00000100:00100000:2.0:1788201323.129406:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681279744 00000100:00100000:2.0:1788201323.129417:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681279360 00000100:00100000:2.0:1788201323.129420:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681279360 00000100:00100000:2.0:1788201323.129432:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681279872 00000100:00100000:2.0:1788201323.129435:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681279872 00000100:00100000:2.0:1788201323.129449:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788201323.129457:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681278720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.129505:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681278720:12345-0@lo:400:kworker.0 Request processed in 48us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.129513:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788201323.129639:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681278976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.129673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.129687:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681279488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.129710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.129728:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681280000:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.129784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.129803:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201323.129809:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681278592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.129848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.129869:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681279104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.129892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.129912:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681279616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.129932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.129957:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681278848 00000100:00100000:1.0:1788201323.129961:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681278848 00000100:00100000:1.0:1788201323.129986:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681279104 00000100:00100000:1.0:1788201323.129989:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681279104 00000100:00100000:1.0:1788201323.130003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788201323.130020:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681278848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130056:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681278848:12345-0@lo:400:kworker.0 Request processed in 38us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.130063:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788201323.130076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788201323.130082:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681279104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130114:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681279104:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.130120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788201323.130153:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681279104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681278976 00000100:00100000:1.0:1788201323.130197:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681278976 00000100:00100000:1.0:1788201323.130216:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788201323.130222:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681279232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130253:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681279232:12345-0@lo:400:kworker.0 Request processed in 32us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.130259:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788201323.130272:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788201323.130279:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681279744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130322:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681279744:12345-0@lo:400:kworker.0 Request processed in 44us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.130328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788201323.130341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788201323.130347:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681279360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130373:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681279360:12345-0@lo:400:kworker.0 Request processed in 26us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.130385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788201323.130401:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788201323.130407:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681279872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130437:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681279872:12345-0@lo:400:kworker.0 Request processed in 31us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.130442:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788201323.130456:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788201323.130462:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681278976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130493:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681278976:12345-0@lo:400:kworker.0 Request processed in 31us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.130499:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:1.0:1788201323.130515:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201323.130520:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201323.130554:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681278976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130589:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681278848:0@lo:400:kworker.0 00010000:00080000:1.0:1788201323.130602:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf840a3480 x1875064681279360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201323.130612:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681279360:0@lo:400:kworker.0 00010000:00080000:1.0:1788201323.130622:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf840a0a80 x1875064681279872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201323.130630:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681279872:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130642:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681278720:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130650:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681279232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.130670:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681279744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201323.131360:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681279488 00000100:00100000:3.0:1788201323.131368:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681279488 00000100:00100000:3.0:1788201323.131417:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681280000 00000100:00100000:3.0:1788201323.131420:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681280000 00000100:00100000:3.0:1788201323.131433:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681279616 00000100:00100000:3.0:1788201323.131435:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681279616 00000100:00100000:3.0:1788201323.131448:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201323.131455:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681279488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201323.131523:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681279488:12345-0@lo:400:kworker.0 Request processed in 69us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201323.131538:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201323.131561:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201323.131568:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681280000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201323.131595:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681280000:12345-0@lo:400:kworker.0 Request processed in 29us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201323.131601:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201323.131611:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788201323.131631:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681279616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201323.131665:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681279616:12345-0@lo:400:kworker.0 Request processed in 48us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201323.131670:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788201323.131692:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681278592 00000100:00100000:3.0:1788201323.131696:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681278592 00000100:00100000:3.0:1788201323.131723:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788201323.131728:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681278592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201323.131779:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681278592:12345-0@lo:400:kworker.0 Request processed in 50us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201323.131799:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:1.0:1788201323.131986:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201323.131990:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201323.132322:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681278592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.132339:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681279616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.132348:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681279488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.132358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681280000:0@lo:400:kworker.0 00000100:00100000:3.0:1788201323.224197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201323.224779:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662333568 00000100:00100000:1.0:1788201323.224789:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662333568 00000100:00100000:1.0:1788201323.224875:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:1.0:1788201323.224887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+14:12162:x1875064662333568:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201323.224914:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201323.224937:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720c55 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc202 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225010:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225024:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225036:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225052:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225058:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225064:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225161:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720c6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225184:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720c6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225191:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720c6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201323.225202:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788201323.225302:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225309:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225316:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225321:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201323.225325:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225331:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225343:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce0b5adb300) 00010000:00010000:1.0:1788201323.225346:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201323.225350:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225357:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720c5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225370:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225382:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225387:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225392:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201323.225395:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225401:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225409:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ce0866ccf00) 00010000:00010000:1.0:1788201323.225411:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201323.225414:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.225419:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720c63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.226281:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720c55 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc202 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.226301:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720c6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc202 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.226309:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:1.0:1788201323.226311:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201323.226319:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254c00, rc 0) 00000100:00100000:1.0:1788201323.226394:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+16:12162:x1875064662333568:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1509us (2206us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788201323.226403:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00080000:2.0:1788201323.226483:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788201323.227443:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1788201323.227459:0:6495:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788201323.227537:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788201323.227548:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788201323.240161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201323.240278:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662333696 00000100:00100000:2.0:1788201323.240287:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662333696 00000100:00100000:2.0:1788201323.240353:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:2.0:1788201323.240363:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+14:12162:x1875064662333696:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788201323.240501:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+14:12162:x1875064662333696:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 139us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.240509:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:0.0:1788201323.248336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201323.248447:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662333824 00000100:00100000:1.0:1788201323.248465:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662333824 00000100:00100000:1.0:1788201323.248537:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:1.0:1788201323.248547:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+14:2400:x1875064662333824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201323.248563:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201323.248599:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720c6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc202 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.248620:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:1.0:1788201323.248625:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201323.248685:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+13:2400:x1875064662333824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 139us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.248693:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:0.0:1788201323.266297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201323.266380:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662333952 00000100:00100000:3.0:1788201323.266389:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662333952 00000100:00100000:3.0:1788201323.266466:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 152 00000100:00100000:3.0:1788201323.266476:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:12162:x1875064662333952:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788201323.266597:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+5:12162:x1875064662333952:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 122us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201323.266605:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 152 00000100:00080000:2.0:1788201323.266854:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1788201323.321493:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201323.639309:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681280128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201323.639379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.639479:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681280128 00000100:00100000:1.0:1788201323.639486:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681280128 00000100:00100000:1.0:1788201323.639539:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788201323.639552:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681280128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201323.639576:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201323.639648:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681280128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.639656:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788201323.639702:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681280128:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1788201323.641063:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00010000:00010000:2.0:1788201323.702422:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201323.720590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201323.720628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201323.720667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201323.720686:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201323.720691:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662334464 00000100:00100000:1.0:1788201323.720700:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662334464 00000100:00100000:3.0:1788201323.720706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201323.720727:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662334208 00000100:00100000:3.0:1788201323.720730:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662334208 00000100:00100000:3.0:1788201323.720776:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662334336 00000100:00100000:1.0:1788201323.720776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662334592 00000100:00100000:3.0:1788201323.720779:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662334336 00000100:00100000:1.0:1788201323.720779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662334592 00000100:00100000:3.0:1788201323.720802:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:1.0:1788201323.720802:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 308 00000100:00100000:3.0:1788201323.720811:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662334208:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201323.720811:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+6:2400:x1875064662334464:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201323.720901:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662334080 00000100:00100000:0.0:1788201323.720905:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662334080 00000100:00100000:0.0:1788201323.720933:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 385 00000100:00100000:0.0:1788201323.720940:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662334080:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201323.721734:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+6:2400:x1875064662334464:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 919us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.721768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 308 00000100:00100000:3.0:1788201323.721790:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662334208:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 980us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.721793:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 309 00000100:00100000:3.0:1788201323.721797:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:1.0:1788201323.721801:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662334592:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201323.721817:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:3.0:1788201323.721835:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662334336:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201323.721843:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662334592:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 44us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.721849:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 309 00000100:00100000:3.0:1788201323.721859:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662334336:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 36us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201323.721865:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00080000:1.0:1788201323.721867:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201323.721872:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201323.721874:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201323.721876:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201323.722131:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662334080:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 1189us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201323.722139:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 385 00000040:00080000:1.0:1788201323.897990:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201323.897999:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201323.898017:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788201323.898024:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788201324.732505:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201325.104426:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.104591:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662334720 00000100:00100000:3.0:1788201325.104600:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662334720 00000100:00100000:3.0:1788201325.104679:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00100000:3.0:1788201325.104689:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+13:12204:x1875064662334720:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201325.104709:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.104729:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc209 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104842:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104856:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104866:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104880:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104886:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104893:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104946:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104954:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104960:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104967:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201325.104971:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104977:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.104989:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:3.0:1788201325.104992:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.104997:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105002:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720c7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105014:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105020:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105027:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105038:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201325.105040:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105046:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105054:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cdf8193a300) 00010000:00010000:3.0:1788201325.105056:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.105059:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105063:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720c86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105093:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720c78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc209 expref: 14 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105103:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:3.0:1788201325.105105:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.105109:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc209 expref: 14 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.105118:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba800, rc 0) 00000100:00100000:3.0:1788201325.105177:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+13:12204:x1875064662334720:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 490us (758us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201325.105185:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00080000:2.0:1788201325.105367:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201325.117909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.118195:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662334976 00000100:00100000:2.0:1788201325.118204:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662334976 00000100:00100000:2.0:1788201325.118296:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 154 00000100:00100000:2.0:1788201325.118307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+13:12204:x1875064662334976:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:2.0:1788201325.118371:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201325.118396:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447205cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc02d expref: 13 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.118414:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:2.0:1788201325.118419:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201325.118486:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.118499:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.118508:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.118542:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.118563:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 5 pid: 6517 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201325.118577:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681280256:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201325.118660:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201325.122868:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681280256:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201325.122908:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.122962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.123026:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662335104 00000100:00100000:3.0:1788201325.123034:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662335104 00000100:00080000:1.0:1788201325.123074:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201325.123079:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 6 pid: 6517 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.123125:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:3.0:1788201325.123141:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1faf6d77-706d-41b4-9836-f216205de0f1+6:2398:x1875064662335104:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201325.123155:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201325.123162:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 6 pid: 6517 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.123175:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 6 pid: 6517 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.123197:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720c4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1fb expref: 6 pid: 6517 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.123212:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:3.0:1788201325.123217:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.123226:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.123232:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.123273:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201325.123332:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662335104:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 197us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.123340:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 81 00010000:00010000:0.0:1788201325.123418:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.123429:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.123451:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.123461:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.123469:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124609:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124624:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124632:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201325.124648:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec943f6d reply state 00000000355d0fc1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124659:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124667:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201325.124670:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201325.124673:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201325.124679:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788201325.124686:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124692:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124699:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124704:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201325.124708:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124727:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124773:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:0.0:1788201325.124776:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.124782:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124789:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720c8d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201325.124808:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec943f6d reply state 00000000355d0fc1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124827:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.124835:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ce0b25e5d00) 00010000:00010000:0.0:1788201325.124838:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201325.124841:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788201325.125149:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+14:12204:x1875064662334976:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 6839us (7245us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788201325.125169:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 154 00000100:00100000:2.0:1788201325.174369:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8370fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681280384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201325.174440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201325.174539:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681280384 00000100:00100000:3.0:1788201325.174549:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681280384 00000100:00100000:3.0:1788201325.174598:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788201325.174606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681280384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201325.174639:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788201325.174685:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681280384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.174702:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788201325.174774:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8370fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681280384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201325.179093:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201325.179118:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681280512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201325.179187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201325.179248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681280512 00000100:00100000:2.0:1788201325.179255:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681280512 00000100:00100000:2.0:1788201325.179299:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788201325.179307:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681280512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201325.179339:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201325.179380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681280512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.179386:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788201325.179430:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681280512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201325.220019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.220132:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662335232 00000100:00100000:3.0:1788201325.220142:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662335232 00000100:00100000:3.0:1788201325.220208:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:3.0:1788201325.220219:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+14:12212:x1875064662335232:12345-192.168.203.2@tcp:101:lctl.0 00010000:00010000:3.0:1788201325.220245:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.220268:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ca2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc210 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.220333:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720ca9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.220348:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.220378:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201325.220429:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201325.220434:0:10723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201325.220459:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.220484:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ca2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc210 expref: 16 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.220569:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc210 expref: 15 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.220578:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:3.0:1788201325.220581:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201325.220584:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb600, rc 0) 00000100:00100000:3.0:1788201325.220645:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+15:12212:x1875064662335232:12345-192.168.203.2@tcp:101:lctl.0 Request processed in 428us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.220653:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:0.0:1788201325.276179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.276352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662335360 00000100:00100000:1.0:1788201325.276362:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662335360 00000100:00100000:1.0:1788201325.276422:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:1.0:1788201325.276431:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+15:12218:x1875064662335360:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201325.276452:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201325.276473:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720cb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc217 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276532:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276546:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276556:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276566:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276573:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276579:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276653:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720cc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276674:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.276681:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201325.276714:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788201325.276718:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201325.277163:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.277180:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.277187:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.277194:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.277200:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201325.277203:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.277210:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.277224:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:1.0:1788201325.277227:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.277232:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.277251:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720cb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.278881:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.278894:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.278902:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.278907:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201325.278911:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.278918:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.278931:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ce0b25e5d00) 00010000:00010000:1.0:1788201325.278934:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.278939:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.278945:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720cbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.279001:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720cb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc217 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.279017:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc217 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.279038:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:1.0:1788201325.279041:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788201325.279044:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254000, rc 0) 00000100:00100000:1.0:1788201325.279109:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+16:12218:x1875064662335360:12345-192.168.203.2@tcp:101:bash.0 Request processed in 2677us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.279119:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:1.0:1788201325.282670:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.282981:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662335616 00000100:00100000:3.0:1788201325.282992:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662335616 00000100:00100000:3.0:1788201325.283051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 157 00000100:00100000:3.0:1788201325.283061:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+16:12218:x1875064662335616:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201325.283089:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.283110:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ccc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc21e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.283233:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.283247:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.283258:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.283273:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.283280:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.283286:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201325.286236:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788201325.286409:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286425:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286435:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286469:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286494:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286501:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286508:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201325.286512:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286520:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286532:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201325.286535:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.286539:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286546:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720cd3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201325.286560:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0129b3f reply state 0000000026a8630d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286572:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286578:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:3.0:1788201325.286580:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201325.286583:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201325.286620:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720ccc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286642:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.286649:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201325.286652:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201325.286654:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:3.0:1788201325.286770:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+19:12218:x1875064662335616:12345-192.168.203.2@tcp:101:bash.0 Request processed in 3677us (4076us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788201325.286780:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 157 00000100:00100000:0.0:1788201325.299523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.299682:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662335744 00000100:00100000:3.0:1788201325.299692:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662335744 00000100:00100000:3.0:1788201325.299801:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:3.0:1788201325.299824:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662335744:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201325.299843:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.299865:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc225 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201325.299892:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201325.299913:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=405s v=(0 0) 00010000:00010000:3.0:1788201325.299918:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201325.299928:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.299949:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.299985:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba800, rc 0) 00000100:00100000:3.0:1788201325.300057:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662335744:12345-192.168.203.2@tcp:101:bash.0 Request processed in 247us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.300065:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00080000:1.0:1788201325.300440:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201325.304922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.305044:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662335872 00000100:00100000:3.0:1788201325.305054:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662335872 00000100:00100000:3.0:1788201325.305113:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1788201325.305123:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:12218:x1875064662335872:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201325.305140:0:8485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.305158:0:8485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc22c expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.305189:0:8485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.305197:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201325.305202:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201325.305207:0:8485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.305237:0:8485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.305250:0:8485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 7 pid: 8430 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.305283:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8370fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8485:1875064681280640:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201325.305496:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201325.314048:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.314153:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662336000 00000100:00100000:1.0:1788201325.314162:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662336000 00010000:00010000:1.0:1788201325.314200:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 8 pid: 8430 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.314512:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:1.0:1788201325.314525:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662336000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201325.314542:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201325.314578:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 8 pid: 8430 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.314595:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 8 pid: 8430 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.314619:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201325.314624:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201325.314632:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.314654:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.314693:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.314708:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce085156680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1875064681280768:192.168.203.2@tcp:105: 00000100:00100000:1.0:1788201325.314836:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf819900c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788201325.314987:0:8485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee44720cef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc225 expref: 8 pid: 8430 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.315004:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8370fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8485:1875064681280640:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201325.315030:0:8485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 7 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.315041:0:8485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbc00, rc 0) 00000100:00100000:3.0:1788201325.315073:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:12218:x1875064662335872:12345-192.168.203.2@tcp:101:bash.0 Request processed in 9952us (10160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.315081:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:1.0:1788201325.319205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.319337:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce085156680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1875064681280768:192.168.203.2@tcp:105: 00010000:00010000:2.0:1788201325.319362:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201325.319423:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662336000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4901us (5384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.319452:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:3.0:1788201325.322828:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662336256 00000100:00100000:3.0:1788201325.322844:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662336256 00000100:00100000:2.0:1788201325.323007:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:2.0:1788201325.323018:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+19:12218:x1875064662336256:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:2.0:1788201325.324119:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+20:12218:x1875064662336256:12345-192.168.203.2@tcp:35:bash.0 Request processed in 1097us (4917us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788201325.324131:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:1.0:1788201325.431323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201325.431428:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662336512 00000100:00100000:0.0:1788201325.431438:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662336512 00000100:00100000:0.0:1788201325.431498:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 158 00000100:00100000:0.0:1788201325.431508:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+20:12228:x1875064662336512:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201325.431535:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201325.431569:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc233 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201325.431699:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788201325.431861:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720cfd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc233 expref: 22 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.431876:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:0.0:1788201325.431883:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201325.431887:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc233 expref: 22 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.431901:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367cc00, rc 0) 00000100:00100000:0.0:1788201325.432437:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+21:12228:x1875064662336512:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 928us (1122us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1788201325.432445:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 158 00000100:00100000:0.0:1788201325.436553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.436809:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662336768 00000100:00100000:2.0:1788201325.436827:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662336768 00000100:00100000:2.0:1788201325.436891:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:2.0:1788201325.436902:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+21:12228:x1875064662336768:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201325.437132:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+22:12228:x1875064662336768:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 217us (573us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788201325.437141:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:3.0:1788201325.525840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.527282:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662336896 00000100:00100000:1.0:1788201325.527360:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662336896 00000100:00100000:1.0:1788201325.527494:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 159 00000100:00100000:1.0:1788201325.527506:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8370fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+22:12234:x1875064662336896:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201325.527556:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201325.527769:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc23a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.527895:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720d12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.527910:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.527922:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201325.527986:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788201325.527990:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201325.528010:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.528038:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc23a expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.528057:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720d12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc23a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.528066:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:1.0:1788201325.528069:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201325.528073:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254c00, rc 0) 00000100:00100000:1.0:1788201325.528204:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8370fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+23:12234:x1875064662336896:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 700us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.528212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 159 00000100:00100000:1.0:1788201325.535464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.535541:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662337152 00000100:00100000:3.0:1788201325.535552:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662337152 00000100:00100000:3.0:1788201325.535706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 160 00000100:00100000:3.0:1788201325.535718:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+23:12234:x1875064662337152:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201325.535772:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.535795:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720d19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc241 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.535932:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720d20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.535945:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.535956:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201325.535965:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788201325.536062:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720d19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc241 expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.536081:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc241 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.536089:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201325.536092:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201325.536095:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba600, rc 0) 00000100:00100000:3.0:1788201325.536147:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+25:12234:x1875064662337152:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 432us (693us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788201325.536155:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 160 00000100:00100000:0.0:1788201325.542801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201325.542855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.542995:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662337408 00000100:00100000:3.0:1788201325.543004:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662337408 00000100:00100000:3.0:1788201325.543063:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:3.0:1788201325.543072:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+25:12234:x1875064662337408:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201325.543095:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.543128:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720d2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc248 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.543242:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720d35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.543255:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.543266:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201325.543277:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788201325.543375:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720d2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc248 expref: 28 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.543396:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720d35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc248 expref: 27 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.543403:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201325.543406:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788201325.543409:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201325.543473:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+27:12234:x1875064662337408:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 402us (925us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788201325.543480:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:2.0:1788201325.551128:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662337536 00000100:00100000:2.0:1788201325.551145:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662337536 00000100:00100000:2.0:1788201325.551311:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:2.0:1788201325.551322:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+27:2399:x1875064662337536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201325.551339:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201325.551363:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720d20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc241 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.551386:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:2.0:1788201325.551390:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201325.551461:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+26:2399:x1875064662337536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 140us (8604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.551481:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1788201325.551643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.551769:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662337664 00000100:00100000:3.0:1788201325.551774:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662337664 00000100:00100000:3.0:1788201325.551807:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:3.0:1788201325.551825:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2401:x1875064662337664:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1788201325.551871:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.551890:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 6 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.551899:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201325.551903:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201325.551908:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.551940:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 6 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.551954:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 6 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.551970:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875064681280896:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201325.552038:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201325.555731:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875064681280896:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201325.555782:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.555932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201325.556020:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662337792 00000100:00100000:0.0:1788201325.556028:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662337792 00002000:00100000:0.0:1788201325.556076:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9cdf836c8000 x1875064662337792/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:446/0 lens 504/0 e 0 to 0 dl 1788201336 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201325.556086:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf836c8000 with x1875064662337792 ext(0->12) 00010000:00010000:0.0:1788201325.556110:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 7 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.556124:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 7 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201325.556133:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cdf836c8000 00000100:00100000:0.0:1788201325.556173:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:0.0:1788201325.556184:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662337792:12345-192.168.203.2@tcp:4:lfs.0 00000100:00100000:0.0:1788201325.557130:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2398:x1875064662337792:12345-192.168.203.2@tcp:4:lfs.0 Request processed in 943us (1193us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788201325.557140:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00002000:00100000:0.0:1788201325.557149:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9cdf836c8000 x1875064662337792/t4294967306(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:446/0 lens 504/448 e 0 to 0 dl 1788201336 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201325.557160:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf836c8000 with x1875064662337792 ext(0->12) 00010000:00010000:0.0:1788201325.557168:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 9 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.557182:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 9 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201325.557190:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cdf836c8000 00000100:00100000:0.0:1788201325.560148:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.560346:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662337920 00000100:00100000:1.0:1788201325.560356:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662337920 00010000:00010000:1.0:1788201325.560396:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 9 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.560438:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:1.0:1788201325.560447:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2398:x1875064662337920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201325.560463:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788201325.560496:0:13184:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788201325.560499:0:13184:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788201324 00002000:00010000:1.0:1788201325.560501:0:13184:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788201324 00002000:00010000:1.0:1788201325.560503:0:13184:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788201324 00002000:00010000:1.0:1788201325.560505:0:13184:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788201325.560512:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 9 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560526:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 9 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560561:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee44720cf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc22c expref: 9 pid: 8485 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560578:0:13184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201325.560592:0:13184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201325.560598:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560615:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560647:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201325.560696:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662337920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 249us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.560703:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 83 00010000:00010000:1.0:1788201325.560728:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560762:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560784:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560792:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560800:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560808:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201325.560821:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560830:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560841:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.560849:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee44720d43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.560908:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2401:x1875064662337664:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 9094us (9266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.560916:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:0.0:1788201325.564835:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.564919:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662338176 00000100:00100000:1.0:1788201325.564930:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662338176 00000100:00100000:1.0:1788201325.564977:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:1.0:1788201325.564988:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf40450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+26:12234:x1875064662338176:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:1.0:1788201325.565054:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720d35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc248 expref: 26 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201325.565241:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788201325.565272:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788201325.565547:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788201325.565585:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.565599:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.565856:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.565896:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.565912:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 30 pid: 6515 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.565948:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875064681281024:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201325.566094:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201325.573265:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.573333:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662338304 00000100:00100000:2.0:1788201325.573342:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662338304 00010000:00010000:2.0:1788201325.573382:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 31 pid: 6515 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201325.573422:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00100000:2.0:1788201325.573433:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+31:2398:x1875064662338304:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201325.573448:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201325.573454:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 31 pid: 6515 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.573467:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 31 pid: 6515 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.573487:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:2.0:1788201325.573493:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.573502:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.573509:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.573526:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201325.573599:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+31:2398:x1875064662338304:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 167us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.573627:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 84 00010000:00010000:1.0:1788201325.575357:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ce1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc21e expref: 30 pid: 6515 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.575383:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875064681281024:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201325.575407:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.575417:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.575422:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201325.575533:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788201325.575849:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788201325.575942:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681281152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788201325.576004:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201325.576094:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf819900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201325.576140:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681281152 00000100:00100000:2.0:1788201325.576146:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681281152 00000100:00100000:2.0:1788201325.576237:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788201325.576247:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681281152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788201325.576345:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681281152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.576352:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788201325.576440:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681281152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788201325.576568:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788201325.576635:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681281280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788201325.576666:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201325.576689:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201325.577033:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681281280 00000100:00100000:2.0:1788201325.577038:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681281280 00000100:00100000:2.0:1788201325.577071:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788201325.577079:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875064681281280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788201325.577176:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1875064681281280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (508us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788201325.577183:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788201325.577381:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875064681281280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788201325.577422:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788201325.577470:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.577479:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.577485:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.577490:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201325.577493:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.577499:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.577513:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:0.0:1788201325.577516:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788201325.577520:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.577524:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d4a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201325.577698:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788201325.577930:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788201325.577943:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405875203370ns, next at 406875200686ns, rc = 0 00000001:00080000:0.0:1788201325.577950:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788201325.577980:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:0.0:1788201325.577983:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788201325.577989:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720d35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc248 expref: 34 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201325.578136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf40450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+33:12234:x1875064662338176:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 13150us (13310us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788201325.578146:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000020:00080000:0.0:1788201325.578150:0:6518:0:(tgt_main.c:807:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1788201325.578300:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201325.581513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.581705:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662338432 00000100:00100000:1.0:1788201325.581715:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662338432 00000100:00100000:1.0:1788201325.581923:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:1.0:1788201325.581934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+33:12234:x1875064662338432:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201325.581958:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201325.581994:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720d51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc24f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.582051:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720d51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc24f expref: 34 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.582064:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720d51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc24f expref: 34 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.582081:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201325.582084:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201325.582087:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255a00, rc 0) 00000100:00100000:1.0:1788201325.582146:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+34:12234:x1875064662338432:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 214us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.582153:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:0.0:1788201325.586280:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.586368:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662338688 00000100:00100000:2.0:1788201325.586378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662338688 00000100:00100000:2.0:1788201325.586435:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:2.0:1788201325.586445:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+34:12234:x1875064662338688:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201325.586706:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+35:12234:x1875064662338688:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 262us (434us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788201325.586714:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:0.0:1788201325.659567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.659798:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662338944 00000100:00100000:3.0:1788201325.659823:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662338944 00000100:00100000:3.0:1788201325.659906:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:3.0:1788201325.659921:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+35:12244:x1875064662338944:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201325.659975:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.660004:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc256 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201325.660178:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788201325.660312:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720d58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc256 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.660330:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:3.0:1788201325.660333:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201325.660340:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc256 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.660360:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75600, rc 0) 00000100:00100000:3.0:1788201325.660520:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+36:12244:x1875064662338944:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 602us (974us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788201325.660529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:3.0:1788201325.667570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.667831:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662339072 00000100:00100000:1.0:1788201325.667843:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662339072 00000100:00100000:1.0:1788201325.667915:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:1.0:1788201325.667926:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+36:12244:x1875064662339072:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:1.0:1788201325.668028:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668048:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668063:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668076:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668101:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668108:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668200:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668207:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668212:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201325.668267:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668282:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668290:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668298:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668304:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201325.668309:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668317:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668336:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:1.0:1788201325.668339:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.668344:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668351:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668366:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668373:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668379:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668384:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201325.668386:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668392:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668398:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:1.0:1788201325.668401:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.668403:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668408:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668426:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668432:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668439:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668443:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201325.668446:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668452:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668459:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201325.668460:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.668463:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.668468:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.668917:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+36:12244:x1875064662339072:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 987us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.668927:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:0.0:1788201325.672446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.672545:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662339328 00000100:00100000:2.0:1788201325.672565:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662339328 00000100:00100000:2.0:1788201325.672650:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:2.0:1788201325.672662:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+36:12244:x1875064662339328:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201325.673255:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+37:12244:x1875064662339328:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 592us (820us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788201325.673265:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:1.0:1788201325.687225:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201325.687257:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681281408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201325.687356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201325.688809:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681281408 00000100:00100000:3.0:1788201325.688837:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681281408 00000100:00100000:3.0:1788201325.688942:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201325.688958:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681281408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201325.689002:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788201325.689089:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681281408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.689097:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1788201325.689182:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201325.689237:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681281408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201325.689562:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681281536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201325.689847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201325.689951:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681281536 00000100:00100000:1.0:1788201325.689957:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681281536 00000100:00100000:1.0:1788201325.690012:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201325.690020:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681281536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201325.690037:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788201325.690079:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681281536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.690086:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201325.690117:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967314 gen 2 00000004:00080000:1.0:1788201325.690124:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf82404a80, transno 4294967314 00000100:00100000:1.0:1788201325.690137:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681281536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201325.691100:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201325.709485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.709608:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662339584 00000100:00100000:1.0:1788201325.709629:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662339584 00000100:00100000:1.0:1788201325.709704:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 165 00000100:00100000:1.0:1788201325.709717:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+37:12247:x1875064662339584:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201325.709797:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201325.709836:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.709932:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.709950:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.709966:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.709998:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710007:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710014:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710155:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710166:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710173:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201325.710184:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788201325.710297:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710304:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710311:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710317:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201325.710322:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710340:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710355:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:1.0:1788201325.710358:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.710364:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710370:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720d82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710388:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710394:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710399:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710404:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201325.710407:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710412:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710419:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:1.0:1788201325.710421:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.710424:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710440:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720d89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710488:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44720d7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710504:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.710512:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201325.710514:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201325.710517:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255e00, rc 0) 00000100:00100000:1.0:1788201325.710591:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+39:12247:x1875064662339584:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 876us (1121us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788201325.710600:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 165 00000100:00100000:3.0:1788201325.713638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201325.713769:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662339712 00000100:00100000:1.0:1788201325.713781:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662339712 00000100:00100000:1.0:1788201325.713864:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00100000:1.0:1788201325.713877:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+39:12247:x1875064662339712:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:1.0:1788201325.713980:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714000:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714013:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714084:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714091:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714097:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714104:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201325.714108:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714115:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714128:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201325.714131:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201325.714136:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.714142:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720d9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.714241:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+39:12247:x1875064662339712:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 367us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.714249:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00100000:0.0:1788201325.717253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.717353:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662339968 00000100:00100000:2.0:1788201325.717365:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662339968 00000100:00100000:2.0:1788201325.717434:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:2.0:1788201325.717447:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+39:12247:x1875064662339968:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201325.717796:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+40:12247:x1875064662339968:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 351us (567us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788201325.717806:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00010000:00010000:1.0:1788201325.750074:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201325.937157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201325.937265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662340224 00000100:00100000:3.0:1788201325.937279:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662340224 00000100:00100000:3.0:1788201325.937368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:3.0:1788201325.937412:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+40:12278:x1875064662340224:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1788201325.937451:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.937481:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720da5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc264 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.937665:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720dac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.937684:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720dac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.937698:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720dac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201325.937712:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788201325.937910:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720da5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc264 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.937938:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720dac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc264 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.937950:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201325.937953:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201325.937958:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74a00, rc 0) 00000100:00100000:3.0:1788201325.938182:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+42:12278:x1875064662340224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 773us (1040us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788201325.938191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:3.0:1788201325.942979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.943085:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662340480 00000100:00100000:2.0:1788201325.943097:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662340480 00000100:00100000:2.0:1788201325.943173:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:2.0:1788201325.943185:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+42:12278:x1875064662340480:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1788201325.943505:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+43:12278:x1875064662340480:12345-192.168.203.2@tcp:35:cat.0 Request processed in 321us (539us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788201325.943513:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1788201325.945276:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201325.945443:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662340608 00000100:00100000:2.0:1788201325.945455:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662340608 00000100:00100000:2.0:1788201325.945562:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1788201325.945573:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+43:2401:x1875064662340608:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201325.945640:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201325.945680:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720dac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc264 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.945706:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:2.0:1788201325.945711:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201325.948529:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+42:2401:x1875064662340608:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2940us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.948547:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1788201326.011094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201326.011253:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662340864 00000100:00100000:1.0:1788201326.011266:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662340864 00000100:00100000:1.0:1788201326.011413:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 168 00000100:00100000:1.0:1788201326.011426:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+42:12284:x1875064662340864:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:1.0:1788201326.011457:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.011461:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201326.011491:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720d12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc23a expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.011514:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:1.0:1788201326.011518:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201326.011533:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720dba lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc26b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.011902:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.011918:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.011927:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.011966:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.011981:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 42 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201326.011998:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681281664:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201326.012134:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf819903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201326.015299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201326.015526:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662340992 00000100:00100000:2.0:1788201326.015538:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662340992 00010000:00010000:2.0:1788201326.015626:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 43 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.015718:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 85 00000100:00100000:2.0:1788201326.015730:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+43:2399:x1875064662340992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201326.015772:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201326.015780:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 43 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.015794:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 43 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.015839:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:2.0:1788201326.015845:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.015878:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.015887:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.015909:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201326.016034:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+43:2399:x1875064662340992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 305us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.016043:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 85 00010000:00010000:1.0:1788201326.022674:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720d90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc25d expref: 42 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201326.022709:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681281664:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201326.023770:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.024721:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.024734:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.024819:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788201326.025022:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720dba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.025062:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 42 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.025073:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201326.025077:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201326.025081:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1a00, rc 0) 00000100:00100000:1.0:1788201326.025180:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+42:12284:x1875064662340864:12345-192.168.203.2@tcp:101:dd.0 Request processed in 13755us (14102us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788201326.025190:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 168 00000100:00100000:3.0:1788201326.033152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201326.033638:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662341120 00000100:00100000:1.0:1788201326.033670:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662341120 00000100:00100000:1.0:1788201326.033773:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 169 00000100:00100000:1.0:1788201326.033785:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+42:12284:x1875064662341120:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:1.0:1788201326.033829:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.033855:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720dcf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc272 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.033900:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.033916:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.033930:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.034082:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720dcf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 44 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.034106:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 43 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.034115:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201326.034119:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201326.034123:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0e00, rc 0) 00000100:00100000:1.0:1788201326.034189:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+43:12284:x1875064662341120:12345-192.168.203.2@tcp:101:dd.0 Request processed in 407us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201326.034197:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 169 00000100:00100000:3.0:1788201326.037458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201326.037574:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662341376 00000100:00100000:1.0:1788201326.037595:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662341376 00000100:00100000:1.0:1788201326.037677:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 170 00000100:00100000:1.0:1788201326.037690:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+43:12284:x1875064662341376:12345-192.168.203.2@tcp:36:dd.0 00010000:00010000:1.0:1788201326.038034:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.038171:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.038185:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201326.038239:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788201326.038267:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2fbe9a7 reply state 0000000085ff29fa transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.038280:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.038288:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201326.038291:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201326.038295:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201326.038405:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+46:12284:x1875064662341376:12345-192.168.203.2@tcp:36:dd.0 Request processed in 716us (960us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788201326.038413:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 170 00000020:00080000:1.0:1788201326.038418:0:6517:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201326.325260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201326.325372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662341504 00000100:00100000:1.0:1788201326.325385:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662341504 00000100:00100000:1.0:1788201326.325463:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 171 00000100:00100000:1.0:1788201326.325485:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+46:12298:x1875064662341504:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:1.0:1788201326.325521:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.325570:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720de4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc279 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.325673:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.325701:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.325715:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.325733:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.331664:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.331684:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.331876:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.331894:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.331903:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.331957:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.331999:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 47 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201326.332018:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681281792:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201326.332154:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf819903c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201326.336029:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681281792:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201326.336072:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201326.355943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201326.356323:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662341760 00000100:00100000:2.0:1788201326.356337:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662341760 00000100:00100000:2.0:1788201326.356414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:2.0:1788201326.356426:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+48:6168:x1875064662341760:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788201326.356882:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+49:6168:x1875064662341760:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 457us (951us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788201326.356890:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1788201326.362500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201326.362628:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662341888 00000100:00100000:0.0:1788201326.362642:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662341888 00010000:00010000:0.0:1788201326.362694:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 49 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201326.362786:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 86 00000100:00100000:0.0:1788201326.362798:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+49:2398:x1875064662341888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201326.362851:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201326.362860:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 49 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.362876:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 49 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.362903:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44720dc1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc26b expref: 49 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.362927:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:0.0:1788201326.362933:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.362945:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.362953:0:13184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.362990:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201326.363073:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+48:2398:x1875064662341888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 276us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201326.363081:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 86 00010000:00010000:3.0:1788201326.363237:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363246:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201326.363314:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788201326.363319:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201326.363350:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363366:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363376:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363384:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363391:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363398:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201326.363402:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363411:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363430:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201326.363433:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.363438:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363704:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44720deb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363719:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363726:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.363732:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.364025:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201326.364029:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.364036:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.364048:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:3.0:1788201326.364050:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.364053:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.364060:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720df2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.364179:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44720de4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc279 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.364195:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc279 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.364203:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201326.364205:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201326.364208:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254c00, rc 0) 00000100:00100000:3.0:1788201326.364283:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+47:12298:x1875064662341504:12345-192.168.203.2@tcp:101:stat.0 Request processed in 38810us (39037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.364292:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 171 00000100:00100000:0.0:1788201326.413833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201326.413979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662342144 00000100:00100000:3.0:1788201326.413992:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662342144 00000100:00100000:3.0:1788201326.414069:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 172 00000100:00100000:3.0:1788201326.414083:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+47:12304:x1875064662342144:12345-192.168.203.2@tcp:36:truncate.0 00010000:00010000:3.0:1788201326.414162:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201326.414197:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720df9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc279 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.414234:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201326.414241:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201326.415009:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.415031:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.415061:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201326.415115:0:6516:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788201326.415139:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5dc16ae reply state 00000000a9fc24c6 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.415152:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.415158:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201326.415162:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201326.415164:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201326.415392:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+49:12304:x1875064662342144:12345-192.168.203.2@tcp:36:truncate.0 Request processed in 1310us (1581us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788201326.415402:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 172 00000020:00080000:3.0:1788201326.415408:0:6516:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201326.543503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201326.543629:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662342272 00000100:00100000:0.0:1788201326.543642:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662342272 00000100:00100000:0.0:1788201326.543715:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:0.0:1788201326.543726:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+49:12318:x1875064662342272:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:0.0:1788201326.543959:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.543988:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720e07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc280 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544072:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544091:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544104:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544117:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544126:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544133:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544228:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544238:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544244:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201326.544297:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788201326.544309:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201326.544340:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544353:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544363:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544369:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544377:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544383:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201326.544387:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544395:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544410:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201326.544414:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.544419:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544426:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee44720e0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544441:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544458:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544464:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544469:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201326.544472:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544478:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544486:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:0.0:1788201326.544489:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.544493:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544499:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44720e15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544532:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720e07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 51 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544546:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.544554:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:0.0:1788201326.544556:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201326.544565:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367ca00, rc 0) 00000100:00100000:0.0:1788201326.544656:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+50:12318:x1875064662342272:12345-192.168.203.2@tcp:101:stat.0 Request processed in 931us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201326.544664:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:2.0:1788201326.601950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201326.602024:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662342528 00000100:00100000:3.0:1788201326.602037:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662342528 00000100:00100000:3.0:1788201326.602115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:3.0:1788201326.602127:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+50:12328:x1875064662342528:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201326.602157:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.602183:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720e23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc287 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201326.602377:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788201326.602513:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720e23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc287 expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.602661:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:3.0:1788201326.602665:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201326.602671:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720e23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc287 expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.602691:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75600, rc 0) 00000100:00100000:3.0:1788201326.602879:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+51:12328:x1875064662342528:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 752us (944us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788201326.602888:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:0.0:1788201326.605486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201326.606300:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662342784 00000100:00100000:2.0:1788201326.606385:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662342784 00000100:00100000:2.0:1788201326.606507:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1788201326.606519:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf40c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+51:12328:x1875064662342784:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201326.607201:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf40c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+52:12328:x1875064662342784:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 679us (1722us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788201326.607211:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:1.0:1788201326.660044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201326.660162:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662343040 00000100:00100000:3.0:1788201326.660175:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662343040 00000100:00100000:3.0:1788201326.660288:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 175 00000100:00100000:3.0:1788201326.660301:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+52:12334:x1875064662343040:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201326.660337:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.660365:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720e31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc28e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.660507:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.660527:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.660538:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.660595:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.660728:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 53 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.660785:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681281920:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201326.660974:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201326.664133:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681281920:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201326.664171:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201326.665950:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201326.666377:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662343168 00000100:00100000:2.0:1788201326.666409:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662343168 00010000:00010000:2.0:1788201326.666460:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 54 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.666548:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 87 00000100:00100000:2.0:1788201326.666561:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+54:2398:x1875064662343168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201326.666594:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201326.666610:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 54 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.666633:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 54 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.666661:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee44720e1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc280 expref: 54 pid: 6517 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.666682:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:2.0:1788201326.667008:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.667024:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.667032:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.667082:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201326.667136:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.667145:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.667156:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+53:2398:x1875064662343168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 597us (1217us total) trans 0 rc 0/0 00000004:00200000:1.0:1788201326.667169:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:2.0:1788201326.667176:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 87 00010000:00010000:1.0:1788201326.667501:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720e31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.667522:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.667530:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201326.667540:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201326.667543:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75200, rc 0) 00000100:00100000:1.0:1788201326.667628:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+53:12334:x1875064662343040:12345-192.168.203.2@tcp:101:bash.0 Request processed in 7323us (7592us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788201326.667637:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 175 00000100:00100000:1.0:1788201326.671345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201326.671453:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662343424 00000100:00100000:3.0:1788201326.671466:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662343424 00000100:00100000:3.0:1788201326.671599:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 176 00000100:00100000:3.0:1788201326.671673:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+53:12334:x1875064662343424:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:3.0:1788201326.672085:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.672107:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.672120:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201326.672167:0:10723:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1788201326.672191:0:10723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d75add30 reply state 00000000bacb01a2 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.672207:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.672233:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201326.672236:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201326.672240:0:10723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201326.672392:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+56:12334:x1875064662343424:12345-192.168.203.2@tcp:36:bash.0 Request processed in 721us (1058us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788201326.673242:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 176 00000020:00080000:3.0:1788201326.673251:0:10723:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201326.677509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201326.677881:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662343552 00000100:00100000:3.0:1788201326.677893:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662343552 00000100:00100000:3.0:1788201326.678011:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 177 00000100:00100000:3.0:1788201326.678024:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+56:12334:x1875064662343552:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201326.678057:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.678084:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720e4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc295 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.678218:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.678236:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 57 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.678247:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.678288:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 57 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.678304:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 57 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.678328:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681282048:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201326.678433:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201326.681858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201326.681974:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662343680 00000100:00100000:2.0:1788201326.681986:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662343680 00010000:00010000:2.0:1788201326.682035:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 58 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.682084:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 88 00000100:00100000:2.0:1788201326.682096:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+58:2399:x1875064662343680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201326.682114:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201326.682122:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 58 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.682138:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 58 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.682166:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:2.0:1788201326.682172:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.682184:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.682193:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.682216:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201326.682287:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+58:2399:x1875064662343680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 191us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.682317:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 88 00010000:00010000:3.0:1788201326.682488:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75200/0xf9b71aee44720e38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc28e expref: 57 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.682511:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875064681282048:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201326.682537:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.682547:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.682553:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201326.682637:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788201326.682643:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201326.682668:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.682703:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75600/0xf9b71aee44720e4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc295 expref: 57 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.682718:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc295 expref: 56 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.682726:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201326.682787:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201326.682791:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201326.682831:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+56:12334:x1875064662343552:12345-192.168.203.2@tcp:101:bash.0 Request processed in 4811us (5338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.682839:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 177 00000100:00100000:1.0:1788201326.685265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201326.685370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662343936 00000100:00100000:0.0:1788201326.685381:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662343936 00000100:00100000:0.0:1788201326.685449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:0.0:1788201326.685462:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+56:12334:x1875064662343936:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:0.0:1788201326.686169:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+57:12334:x1875064662343936:12345-192.168.203.2@tcp:35:bash.0 Request processed in 707us (915us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788201326.686179:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:1.0:1788201326.771122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201326.771221:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662344192 00000100:00100000:3.0:1788201326.771235:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662344192 00000100:00100000:3.0:1788201326.771313:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 178 00000100:00100000:3.0:1788201326.771326:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+57:12344:x1875064662344192:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201326.771359:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.771387:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc29c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201326.771637:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788201326.771783:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc29c expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.771800:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:3.0:1788201326.771915:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201326.771923:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc29c expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.771940:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:3.0:1788201326.772054:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+58:12344:x1875064662344192:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 730us (947us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788201326.772062:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 178 00010000:00010000:2.0:1788201326.773934:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201326.786222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201326.786326:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662344320 00000100:00100000:3.0:1788201326.786345:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662344320 00000100:00100000:3.0:1788201326.786464:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 179 00000100:00100000:3.0:1788201326.786475:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+58:12344:x1875064662344320:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:3.0:1788201326.786564:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786583:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786595:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786615:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786622:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786628:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786709:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786716:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786721:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201326.786818:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786843:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786850:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786857:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786864:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201326.786868:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786875:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786888:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201326.786890:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.786894:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786899:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786913:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786919:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786924:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786933:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201326.786936:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786941:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786947:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:3.0:1788201326.786948:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.786951:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786955:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786963:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786968:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786973:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786977:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201326.786980:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786985:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.786999:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201326.787001:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.787003:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.787009:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.787085:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+58:12344:x1875064662344320:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 611us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.787092:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 179 00000100:00100000:1.0:1788201326.793633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201326.793718:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662344576 00000100:00100000:2.0:1788201326.793730:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662344576 00000100:00100000:2.0:1788201326.793828:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:2.0:1788201326.793838:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+58:12344:x1875064662344576:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201326.794116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+59:12344:x1875064662344576:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 277us (496us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788201326.794124:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:1.0:1788201326.835015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201326.835656:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662344832 00000100:00100000:3.0:1788201326.835670:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662344832 00000100:00100000:3.0:1788201326.835784:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 180 00000100:00100000:3.0:1788201326.835796:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+59:12347:x1875064662344832:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201326.835841:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.835867:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.835962:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.835981:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.835994:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836006:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836032:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836040:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836175:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720e93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836187:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720e93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836195:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720e93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201326.836207:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788201326.836515:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836524:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836532:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836540:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201326.836545:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836554:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836581:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201326.836584:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.836591:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836598:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720e85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836616:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836623:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836630:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836635:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201326.836638:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836645:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836651:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:3.0:1788201326.836654:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.836656:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836662:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720e8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836718:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720e7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2a3 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836733:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720e93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2a3 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.836962:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201326.836964:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201326.836967:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba600, rc 0) 00000100:00100000:3.0:1788201326.837043:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+61:12347:x1875064662344832:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1249us (2039us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788201326.837052:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 180 00000100:00100000:1.0:1788201326.841942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201326.841994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201326.842117:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662344960 00000100:00100000:0.0:1788201326.842129:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662344960 00000100:00100000:0.0:1788201326.842220:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:0.0:1788201326.842231:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+61:2398:x1875064662344960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201326.842250:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201326.842282:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44720e93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2a3 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.842317:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:0.0:1788201326.842324:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201326.842397:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+60:2398:x1875064662344960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 167us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201326.842405:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:3.0:1788201326.843526:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662345088 00000100:00100000:3.0:1788201326.843536:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662345088 00000100:00100000:3.0:1788201326.843595:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:3.0:1788201326.843605:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+60:12347:x1875064662345088:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:3.0:1788201326.843685:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843705:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843718:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843812:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843842:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843849:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843856:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201326.843861:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843871:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843883:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201326.843886:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201326.843891:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.843899:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.843965:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+60:12347:x1875064662345088:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 362us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.843974:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:1.0:1788201326.859984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201326.860090:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662345344 00000100:00100000:2.0:1788201326.860103:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662345344 00000100:00100000:2.0:1788201326.860181:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:2.0:1788201326.860193:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+60:12347:x1875064662345344:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201326.860556:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+61:12347:x1875064662345344:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 364us (587us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788201326.860564:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:1.0:1788201327.048702:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201327.049412:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662345600 00000100:00100000:3.0:1788201327.049426:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662345600 00000100:00080000:2.0:1788201327.049736:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201327.049924:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:3.0:1788201327.049942:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+61:12365:x1875064662345600:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1788201327.049974:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201327.050019:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2aa expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.050153:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720eaf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.050171:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720eaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.050183:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720eaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201327.050209:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788201327.050353:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ea8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2aa expref: 64 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.050378:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720eaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2aa expref: 63 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.050387:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201327.050390:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788201327.050394:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:3.0:1788201327.050487:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12365:x1875064662345600:12345-192.168.203.2@tcp:101:cat.0 Request processed in 552us (1798us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788201327.050495:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:1.0:1788201327.080888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201327.081523:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662345728 00000100:00100000:3.0:1788201327.081545:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662345728 00000100:00100000:3.0:1788201327.081670:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:3.0:1788201327.081682:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12366:x1875064662345728:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201327.081769:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201327.081798:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.081897:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720ec4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.081916:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.081930:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201327.081990:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788201327.081994:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201327.082017:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.082048:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b1 expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.082070:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b1 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.082079:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201327.082082:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201327.082087:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb800, rc 0) 00000100:00100000:3.0:1788201327.082170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12366:x1875064662345728:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 490us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201327.082178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:1.0:1788201327.100353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201327.100726:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662346112 00000100:00100000:2.0:1788201327.100765:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662346112 00000100:00100000:2.0:1788201327.100902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:2.0:1788201327.100915:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12366:x1875064662346112:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201327.101320:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12366:x1875064662346112:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 406us (980us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788201327.101329:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:1.0:1788201327.104253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201327.104311:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662346240 00000100:00100000:3.0:1788201327.104324:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662346240 00000100:00100000:3.0:1788201327.104413:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:3.0:1788201327.104426:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12366:x1875064662346240:12345-192.168.203.2@tcp:103:lfs.0 00010000:00010000:3.0:1788201327.104458:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788201327.104507:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720e54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc295 expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.104538:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720eaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2aa expref: 64 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.104553:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720d51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc24f expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.104566:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201327.104572:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201327.104649:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+62:12366:x1875064662346240:12345-192.168.203.2@tcp:103:lfs.0 Request processed in 226us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201327.104656:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:1.0:1788201327.106694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201327.106789:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662346368 00000100:00100000:0.0:1788201327.106827:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662346368 00000100:00100000:0.0:1788201327.106902:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:0.0:1788201327.106913:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+62:12366:x1875064662346368:12345-192.168.203.2@tcp:58:lfs.0 00010000:00010000:0.0:1788201327.107079:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.107103:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.107117:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201327.107242:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788201327.107346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+62:12366:x1875064662346368:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 434us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201327.107355:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:0.0:1788201327.129770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201327.130015:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662346496 00000100:00100000:3.0:1788201327.130029:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662346496 00000100:00100000:3.0:1788201327.130118:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 185 00000100:00100000:3.0:1788201327.130131:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+62:12368:x1875064662346496:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201327.130160:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201327.130190:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ed2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2b8 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130302:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130320:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130333:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130346:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130353:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130360:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130463:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130474:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130481:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201327.130534:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788201327.130539:0:10723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201327.130562:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130586:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130710:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130720:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130727:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130733:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201327.130798:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130818:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130834:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201327.130838:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201327.130843:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130851:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720ed9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130869:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130876:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130890:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130895:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201327.130899:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130906:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130914:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:3.0:1788201327.130917:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201327.130920:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130926:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720ee0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130960:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ed2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 64 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130975:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 63 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.130982:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:3.0:1788201327.130984:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201327.130986:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bae00, rc 0) 00000100:00100000:3.0:1788201327.131067:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12368:x1875064662346496:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 938us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201327.131084:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 185 00010000:00010000:1.0:1788201327.804116:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201327.896293:0:14704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201327.896306:0:14704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201327.896348:0:14704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788201327.896357:0:14704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788201327.990014:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201327.990028:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201327.990061:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788201327.990070:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201327.990245:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681282176:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788201327.990437:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201328.005033:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681282176:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788201328.007659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.007873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662346624 00000100:00100000:2.0:1788201328.007894:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662346624 00000100:00100000:2.0:1788201328.007968:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:2.0:1788201328.007980:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12381:x1875064662346624:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788201328.008018:0:6515:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788201328.008157:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12381:x1875064662346624:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 178us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.008165:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:0.0:1788201328.011432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.013897:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662346752 00000100:00100000:1.0:1788201328.013925:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662346752 00000100:00100000:1.0:1788201328.014065:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 187 00000100:00100000:1.0:1788201328.014077:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12381:x1875064662346752:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788201328.014175:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014196:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014210:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014390:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014415:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014429:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014471:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014482:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014492:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201328.014555:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788201328.014560:0:8476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201328.014592:0:8476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014606:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014614:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014622:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014630:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201328.014635:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014643:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014657:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:1.0:1788201328.014660:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201328.014665:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014672:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44720eee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014689:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014695:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014702:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014717:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201328.014721:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014728:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014783:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9ce0866cc700) 00010000:00010000:1.0:1788201328.014786:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201328.014789:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014805:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720ef5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014896:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014906:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014914:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014920:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201328.014923:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014930:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014949:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201328.014951:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201328.014954:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.014961:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720efc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.015060:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12381:x1875064662346752:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 982us (3639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.015070:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 187 00000100:00100000:0.0:1788201328.020629:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.020943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662347008 00000100:00100000:1.0:1788201328.020956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662347008 00000100:00100000:1.0:1788201328.021033:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 188 00000100:00100000:1.0:1788201328.021047:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12381:x1875064662347008:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201328.021076:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201328.021104:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720f03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021244:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021262:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021276:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201328.021289:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788201328.021404:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021412:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021420:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021428:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201328.021433:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021441:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021458:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201328.021461:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201328.021466:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021473:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021520:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720f03 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2bf expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021532:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:1.0:1788201328.021534:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201328.021539:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44720f03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2bf expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.021560:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201328.021641:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12381:x1875064662347008:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 596us (1023us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1788201328.021650:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 188 00000100:00100000:1.0:1788201328.028628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.028863:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662347136 00000100:00100000:0.0:1788201328.028876:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662347136 00000100:00100000:0.0:1788201328.029078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 189 00000100:00100000:0.0:1788201328.029093:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12381:x1875064662347136:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788201328.029141:0:6517:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788201328.029285:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12381:x1875064662347136:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 195us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.029294:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 189 00000100:00100000:3.0:1788201328.035709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.035876:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662347392 00000100:00100000:0.0:1788201328.035896:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662347392 00000100:00100000:0.0:1788201328.035970:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 190 00000100:00100000:0.0:1788201328.035982:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12381:x1875064662347392:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201328.036014:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201328.036019:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788201328.036060:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee44720ec4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b1 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.036086:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201328.036092:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201328.036109:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720f18 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2c6 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201328.036595:0:8476:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788201328.036813:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720f1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.036831:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720f1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.036844:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720f1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.036914:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720f18 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2c6 expref: 66 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.036931:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720f1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2c6 expref: 65 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.036954:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:0.0:1788201328.036958:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201328.036961:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367ce00, rc 0) 00000100:00100000:0.0:1788201328.037046:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12381:x1875064662347392:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1065us (1351us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788201328.037054:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 190 00000100:00100000:0.0:1788201328.049726:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.049849:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662347648 00000100:00100000:2.0:1788201328.049862:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662347648 00000100:00100000:2.0:1788201328.049936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:2.0:1788201328.049948:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12381:x1875064662347648:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201328.050021:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201328.050057:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44720f1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2c6 expref: 65 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050079:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5100) 00010000:00010000:2.0:1788201328.050091:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201328.050121:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050139:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050150:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050177:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050205:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050213:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050274:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050280:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050287:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050294:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.050298:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050306:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050313:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:2.0:1788201328.050316:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201328.050320:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050326:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050335:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050345:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050351:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050356:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.050359:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050364:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050371:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xece310fa (ffff9ce094419b00) 00010000:00010000:2.0:1788201328.050373:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201328.050375:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.050381:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44720f34 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xece310fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.050476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12381:x1875064662347648:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 530us (765us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201328.050483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:1.0:1788201328.055003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.055291:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662347776 00000100:00100000:0.0:1788201328.055303:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662347776 00000100:00100000:0.0:1788201328.055384:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:0.0:1788201328.055397:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12381:x1875064662347776:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201328.055427:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201328.055456:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720f3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2cd expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.055506:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.055523:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.055542:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.055692:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44720f3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 66 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.055730:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 65 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.055777:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:0.0:1788201328.055781:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201328.055785:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d200, rc 0) 00000100:00100000:0.0:1788201328.055877:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12381:x1875064662347776:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 482us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.055886:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:0.0:1788201328.059790:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.059938:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662348032 00000100:00100000:1.0:1788201328.059952:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662348032 00000100:00100000:1.0:1788201328.060034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:1.0:1788201328.060047:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12381:x1875064662348032:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201328.060168:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.060191:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.060205:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201328.060433:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788201328.060445:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 408357705660ns, next at 409357702754ns, rc = 0 00000004:00010000:1.0:1788201328.060506:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f47826dc reply state 00000000c0bbbba1 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.060596:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.060605:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:1.0:1788201328.060626:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788201328.060631:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201328.060832:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+67:12381:x1875064662348032:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 785us (1056us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788201328.060841:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:1.0:1788201328.064407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.064472:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662348160 00000100:00100000:2.0:1788201328.064484:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662348160 00000100:00100000:2.0:1788201328.064560:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:2.0:1788201328.064574:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+67:12381:x1875064662348160:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201328.064689:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201328.064732:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2d4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.064874:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.064977:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.065005:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:2.0:1788201328.065008:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201328.065012:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1400, rc 0) 00000100:00100000:2.0:1788201328.065090:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+68:12381:x1875064662348160:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 520us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.065098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:2.0:1788201328.070556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.070629:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662348288 00000100:00100000:0.0:1788201328.070642:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662348288 00000100:00100000:0.0:1788201328.070731:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1788201328.070772:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2398:x1875064662348288:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788201328.070811:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201328.071283:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662348288:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 514us (739us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788201328.071293:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1788201328.074944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.075213:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662348544 00000100:00100000:2.0:1788201328.075225:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662348544 00000100:00100000:2.0:1788201328.075304:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:2.0:1788201328.075315:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+68:12381:x1875064662348544:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788201328.075610:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+69:12381:x1875064662348544:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 296us (678us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788201328.075618:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:1.0:1788201328.083623:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.085404:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662348800 00000100:00100000:0.0:1788201328.085423:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662348800 00000100:00100000:0.0:1788201328.085539:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 195 00000100:00100000:0.0:1788201328.085552:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+69:12381:x1875064662348800:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788201328.085716:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+69:12381:x1875064662348800:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 166us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.085804:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 195 00000100:00100000:1.0:1788201328.089254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.090229:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662348928 00000100:00100000:2.0:1788201328.090246:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662348928 00000100:00100000:2.0:1788201328.090383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 196 00000100:00100000:2.0:1788201328.090398:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+69:12381:x1875064662348928:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201328.090444:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201328.090472:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720f57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2db expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.090562:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.090580:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.090593:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201328.090651:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201328.090677:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.090710:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1a00/0xf9b71aee44720f57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2db expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.090733:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2db expref: 70 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.090820:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:2.0:1788201328.090824:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788201328.090829:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1200, rc 0) 00000100:00100000:2.0:1788201328.090971:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+70:12381:x1875064662348928:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 577us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.090980:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 196 00000100:00100000:3.0:1788201328.093821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.093935:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662349056 00000100:00100000:0.0:1788201328.093949:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662349056 00000100:00100000:0.0:1788201328.094019:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1788201328.094032:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662349056:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201328.094056:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201328.094082:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201328.094114:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c96f, blocks: 0x0 00010000:00010000:0.0:1788201328.094140:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1788201328.094146:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201328.094157:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.094179:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.094195:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367c200, rc 0) 00000100:00100000:0.0:1788201328.094582:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662349056:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 550us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.094590:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1788201328.105973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.106077:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662349312 00000100:00100000:2.0:1788201328.106088:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662349312 00000100:00100000:2.0:1788201328.106153:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 197 00000100:00100000:2.0:1788201328.106163:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+70:12381:x1875064662349312:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788201328.106331:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+70:12381:x1875064662349312:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 169us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.106339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 197 00000100:00100000:2.0:1788201328.109128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201328.109249:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662349440 00000100:00100000:3.0:1788201328.109262:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662349440 00000100:00100000:3.0:1788201328.109387:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:3.0:1788201328.109400:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:12381:x1875064662349440:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201328.109424:0:8485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201328.109449:0:8485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2e9 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.109491:0:8485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.109502:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201328.109507:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201328.109513:0:8485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 9 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.109558:0:8485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.109589:0:8485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 9 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201328.109618:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8485:1875064681282304:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201328.109788:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201328.117108:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8485:1875064681282304:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201328.117158:0:8485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 9 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.117259:0:8485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:0.0:1788201328.117387:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+9:12381:x1875064662349440:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 7988us (8270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.117397:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:1.0:1788201328.120338:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.120527:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662349568 00000100:00100000:0.0:1788201328.120540:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662349568 00010000:00010000:0.0:1788201328.120593:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 9 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201328.120647:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 89 00000100:00100000:0.0:1788201328.120670:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2399:x1875064662349568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201328.120691:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201328.120720:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 9 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.120782:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 9 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.120821:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee44720f65 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e2 expref: 9 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.120845:0:13184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201328.120851:0:13184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201328.120862:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.120894:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.120945:0:13184:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201328.120964:0:13184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13184:1875064681282432:192.168.203.2@tcp:105: 00000100:00100000:0.0:1788201328.121082:0:13184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201328.127178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.127315:0:13184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13184:1875064681282432:192.168.203.2@tcp:105: 00010000:00010000:0.0:1788201328.127349:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201328.127434:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662349568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6776us (7110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.127447:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 89 00000100:00100000:3.0:1788201328.127568:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662349696 00000100:00100000:3.0:1788201328.127576:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662349696 00002000:00100000:3.0:1788201328.127640:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9cdf840e6d80 x1875064662349696/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:449/0 lens 504/0 e 0 to 0 dl 1788201339 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201328.127651:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf840e6d80 with x1875064662349696 ext(0->8) 00002000:00010000:3.0:1788201328.127656:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf840e6d80 00000100:00100000:3.0:1788201328.127684:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:3.0:1788201328.127694:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662349696:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788201328.129561:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+10:2398:x1875064662349696:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 Request processed in 1854us (2384us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788201328.129575:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00002000:00100000:3.0:1788201328.129588:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9cdf840e6d80 x1875064662349696/t4294967316(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:449/0 lens 504/448 e 0 to 0 dl 1788201339 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201328.129610:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf840e6d80 with x1875064662349696 ext(0->8) 00002000:00010000:3.0:1788201328.129617:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf840e6d80 00000100:00100000:2.0:1788201328.131860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.132223:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662349824 00000100:00100000:1.0:1788201328.132235:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662349824 00000100:00100000:1.0:1788201328.132340:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 198 00000100:00100000:1.0:1788201328.132351:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+70:12381:x1875064662349824:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788201328.134370:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788201328.134388:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788201328.134471:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788201328.134489:0:6495:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce0ba3b7840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788201328.134494:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0c149bb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce0ba3b7f00 00000020:00080000:3.0:1788201328.134498:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0c149b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cdf837f2600 00000100:00100000:0.0:1788201328.134699:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201328.134722:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681282560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788201328.134841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.135084:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681282560 00000100:00100000:1.0:1788201328.135093:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681282560 00000100:00100000:1.0:1788201328.135162:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201328.135174:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681282560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788201328.135335:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788201328.135339:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788201327 00002000:00010000:1.0:1788201328.135342:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788201328.135343:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788201327 -> 1788201327 00002000:00010000:1.0:1788201328.135345:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788201328.135391:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681282560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (549us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788201328.135398:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201328.135527:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+25:12381:x1875064662349824:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 3175us (3680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.135631:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681282688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201328.135663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788201328.135705:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ce0bf680e00/2, rc 0, transno 4294967317 00000100:00100000:0.0:1788201328.135712:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681282560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788201328.135732:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681282688 00000100:00100000:0.0:1788201328.135757:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681282688 00000100:00100000:0.0:1788201328.135786:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201328.135802:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681282688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201328.135832:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1788201328.135863:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a95c96c, atime: 0x6a95c96c, ctime: 0x6a95c96c, blocks: 0x8 00010000:00010000:0.0:1788201328.135871:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.135891:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1788201328.135896:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201328.135903:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.135922:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.135932:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.135940:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.135959:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201328.136083:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681282688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 290us (418us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788201328.136089:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:0.0:1788201328.136118:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf841b9c00/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788201328.136123:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681282688:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788201328.136282:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201328.136287:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201328.136430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 198 00010000:00010000:1.0:1788201328.136455:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201328.136463:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.136473:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367da00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201328.136478:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.136488:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.136508:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.136515:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004b9807a/0xf9b71aee44720f73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.136648:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.136651:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.136652:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201328.138988:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139033:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139043:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139050:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.139055:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139065:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139086:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ce0b25e5d00) 00010000:00010000:2.0:1788201328.139090:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201328.139096:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139128:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee44720c94 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139156:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139163:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139170:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139176:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367dc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.139179:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139185:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139193:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:2.0:1788201328.139196:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201328.139199:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139205:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44720c9b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139225:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139231:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139243:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139249:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.139251:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139257:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139266:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a300) 00010000:00010000:2.0:1788201328.139268:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201328.139271:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139275:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44720cda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139293:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139300:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139306:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139311:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.139314:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139330:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139340:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:2.0:1788201328.139343:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201328.139345:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139351:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44720ddd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139364:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139371:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139377:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139382:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.139386:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139391:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139399:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:2.0:1788201328.139401:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201328.139403:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139418:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75400/0xf9b71aee44720e00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139432:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139439:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139445:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139450:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.139453:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139459:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139468:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:2.0:1788201328.139471:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201328.139474:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139479:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74a00/0xf9b71aee44720e46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139492:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139498:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139511:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139516:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201328.139519:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139526:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139550:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:2.0:1788201328.139552:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201328.139555:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.139561:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788201328.140038:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788201328.140127:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788201328.140364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.140474:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662349952 00000100:00100000:1.0:1788201328.140488:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662349952 00000100:00100000:1.0:1788201328.140692:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:1.0:1788201328.140707:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+10:2399:x1875064662349952:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788201328.144862:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1788201328.144882:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:1.0:1788201328.145282:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662349952:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 4569us (4913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.145317:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:1.0:1788201328.148085:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.148176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662350208 00000100:00100000:2.0:1788201328.148187:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662350208 00000100:00100000:2.0:1788201328.148263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 199 00000100:00100000:2.0:1788201328.148274:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+19:12381:x1875064662350208:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201328.148344:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201328.148377:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2db expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.148401:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:2.0:1788201328.148407:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201328.148463:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.148480:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.148491:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201328.149085:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017114f3d reply state 0000000081eee68a transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.149103:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.149110:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:2.0:1788201328.149113:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201328.149116:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201328.149244:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+20:12381:x1875064662350208:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 970us (1170us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788201328.149253:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 199 00000100:00100000:2.0:1788201328.151837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.151928:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662350336 00000100:00100000:0.0:1788201328.151940:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662350336 00000100:00100000:0.0:1788201328.152012:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:0.0:1788201328.152024:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662350336:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788201328.152219:0:8485:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788201328.152223:0:8485:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788201327 -> 1788201326 00002000:00010000:0.0:1788201328.152226:0:8485:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788201324 00002000:00010000:0.0:1788201328.152228:0:8485:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788201327 -> 1788201326 00002000:00010000:0.0:1788201328.152231:0:8485:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788201328.152312:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662350336:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 290us (487us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788201328.152321:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:0.0:1788201328.156714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.156843:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662350592 00000100:00100000:2.0:1788201328.156855:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662350592 00000100:00100000:2.0:1788201328.156925:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 200 00000100:00100000:2.0:1788201328.156937:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce085155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+20:12381:x1875064662350592:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788201328.157030:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.157048:0:10723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 20 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.157078:0:10723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.157116:0:10723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 20 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.157130:0:10723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 20 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.157146:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf840e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681282816:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201328.157240:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201328.159705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201328.159853:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662350720 00000100:00100000:3.0:1788201328.159864:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662350720 00010000:00010000:3.0:1788201328.159914:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 21 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201328.159963:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 90 00000100:00100000:3.0:1788201328.159973:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+21:2399:x1875064662350720:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201328.159992:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201328.160000:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 21 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.160015:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 21 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.160042:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:3.0:1788201328.160047:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.160070:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.160100:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.160126:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201328.160202:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+21:2399:x1875064662350720:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 229us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.160211:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 90 00010000:00010000:0.0:1788201328.160483:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720f42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2cd expref: 20 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201328.160502:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf840e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681282816:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201328.160529:0:10723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160539:0:10723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160544:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160619:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160628:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160635:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160642:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201328.160647:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160655:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160667:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:0.0:1788201328.160670:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788201328.160674:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.160680:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee44720f81 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201328.160789:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce085155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+19:12381:x1875064662350592:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 Request processed in 3803us (4038us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788201328.160808:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 200 00000100:00100000:2.0:1788201328.164090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.164175:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662350848 00000100:00100000:0.0:1788201328.164187:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662350848 00000100:00100000:0.0:1788201328.164254:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:0.0:1788201328.164284:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2400:x1875064662350848:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788201328.164344:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.164370:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.164379:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201328.164384:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201328.164389:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.164451:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 8 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.164467:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 8 pid: 8485 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201328.164484:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875064681282944:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201328.164600:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082bbdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201328.167791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.168003:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875064681282944:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201328.168041:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.168161:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662350976 00000100:00100000:2.0:1788201328.168170:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662350976 00010000:00010000:2.0:1788201328.168214:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 9 pid: 8485 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.168256:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:2.0:1788201328.168268:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2398:x1875064662350976:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201328.168287:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201328.168312:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 9 pid: 8485 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.168325:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 9 pid: 8485 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.168370:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f47c23a/0xf9b71aee44720f6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2e9 expref: 9 pid: 8485 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.168388:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201328.168392:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201328.168398:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.168408:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.168441:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201328.168510:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662350976:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 244us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.168518:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 91 00010000:00010000:0.0:1788201328.168578:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.168610:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.168637:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.168645:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.168653:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.168661:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201328.168666:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.168677:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.168690:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.168699:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a0f7592/0xf9b71aee44720f88 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201328.168815:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662350848:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 4534us (4738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.168823:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:2.0:1788201328.171497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.171898:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662351232 00000100:00100000:1.0:1788201328.171910:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662351232 00000100:00100000:1.0:1788201328.171981:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 201 00000100:00100000:1.0:1788201328.171994:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+19:12381:x1875064662351232:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788201328.172098:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.172119:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 19 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.172129:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.172174:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 19 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.172189:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 19 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.172206:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681283072:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201328.172314:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201328.175118:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681283072:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201328.175159:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.176192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201328.176279:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662351360 00000100:00100000:0.0:1788201328.176287:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662351360 00010000:00010000:0.0:1788201328.176331:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 20 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201328.176368:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00100000:0.0:1788201328.176378:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+20:2399:x1875064662351360:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201328.176394:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201328.176401:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 20 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.176414:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 20 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.176438:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44720dd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc272 expref: 20 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.176457:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:0.0:1788201328.176462:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.176474:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.176495:0:13184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.176527:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201328.176636:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+19:2399:x1875064662351360:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 259us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.176643:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 92 00010000:00010000:1.0:1788201328.176839:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.176849:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.177044:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.177056:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.177065:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.177096:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.177109:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 19 pid: 6515 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.177123:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681283200:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201328.177187:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201328.179327:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681283200:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201328.179360:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.180825:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201328.180977:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662351488 00000100:00100000:3.0:1788201328.180987:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662351488 00010000:00010000:3.0:1788201328.181036:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 20 pid: 6515 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201328.181079:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 93 00000100:00100000:3.0:1788201328.181090:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+20:2398:x1875064662351488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201328.181108:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201328.181116:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 20 pid: 6515 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.181130:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 20 pid: 6515 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.181155:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44720f50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2d4 expref: 20 pid: 6515 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.181173:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:3.0:1788201328.181178:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.181212:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.181220:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.181257:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201328.181328:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+19:2398:x1875064662351488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 239us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.181336:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 93 00010000:00010000:1.0:1788201328.181920:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.181938:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201328.182079:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788201328.182215:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788201328.182254:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788201328.182350:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875064681283328:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201328.182430:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.182518:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f14c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201328.183334:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681283328 00000100:00100000:2.0:1788201328.183345:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681283328 00000100:00100000:2.0:1788201328.183440:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788201328.183451:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1875064681283328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201328.183852:0:6517:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1788201328.183859:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ce0bf680e00, transno 4294967317 00000100:00100000:1.0:1788201328.183881:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875064681283328:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788201328.184044:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788201328.184110:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875064681283456:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201328.184384:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.184454:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b9696900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201328.184492:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681283456 00000100:00100000:0.0:1788201328.184497:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681283456 00000100:00100000:0.0:1788201328.184572:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788201328.184595:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6517:x1875064681283456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201328.184730:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6517:x1875064681283456:12345-0@lo:1000:mdt00_002.0 Request processed in 150us (345us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788201328.184758:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788201328.184960:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1875064681283328:12345-0@lo:1000:mdt00_002.0 Request processed in 1509us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.184968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788201328.185062:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875064681283456:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788201328.185111:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185124:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185133:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185141:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201328.185146:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185161:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185179:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:1.0:1788201328.185182:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201328.185188:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185194:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44720f96 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185224:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185231:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185236:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185241:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201328.185244:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185250:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185261:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201328.185263:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201328.185266:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185281:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee44720ecb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185311:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185329:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 22 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185339:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185369:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 22 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.185384:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 22 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.185397:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681283584:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201328.185472:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b9696900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201328.188393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.188948:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662351616 00000100:00100000:1.0:1788201328.188960:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662351616 00010000:00010000:1.0:1788201328.189013:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 23 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.189060:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 94 00000100:00100000:1.0:1788201328.189072:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+23:2398:x1875064662351616:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201328.189089:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201328.189109:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 23 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189124:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 23 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189153:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201328.189158:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189170:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189178:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189199:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201328.189265:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+23:2398:x1875064662351616:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 195us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.189274:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 94 00010000:00010000:1.0:1788201328.189345:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720ee7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2b8 expref: 22 pid: 10723 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.189369:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681283584:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201328.189399:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189411:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189428:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189443:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189450:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189458:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189465:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201328.189469:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189478:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189488:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201328.189491:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201328.189495:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189502:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee44720f9d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189515:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.189522:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.191702:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.191711:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201328.191716:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.191727:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.191759:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ce0866cc000) 00010000:00010000:1.0:1788201328.191762:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201328.191766:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.191774:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44720f8f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.192030:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+21:12381:x1875064662351232:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 20033us (20538us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788201328.192041:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 201 00000020:00080000:1.0:1788201328.192048:0:6517:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788201328.192312:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201328.192318:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201328.192396:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788201328.192405:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201328.194813:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201328.195256:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662351872 00000100:00100000:3.0:1788201328.195268:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662351872 00000100:00100000:0.0:1788201328.195449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:0.0:1788201328.195463:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf42850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+21:12381:x1875064662351872:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788201328.196082:0:6519:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788201328.196123:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788201328.196165:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.196185:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.196198:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.196208:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.196235:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.196241:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.196266:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201328.196448:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201328.196457:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.196465:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201328.196469:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.196478:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.196492:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:2.0:1788201328.196495:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201328.196500:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.196506:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44720fa4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.196519:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201328.196521:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201328.196522:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201328.196565:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf42850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+23:12381:x1875064662351872:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 1103us (1770us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788201328.196576:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000020:00080000:0.0:1788201328.196595:0:6519:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201328.246002:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201328.246032:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681283712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201328.246127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.246286:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681283712 00000100:00100000:3.0:1788201328.246296:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681283712 00000100:00100000:3.0:1788201328.246363:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201328.246375:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681283712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201328.246415:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788201328.246481:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681283712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.246489:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201328.246640:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681283712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201328.249836:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201328.249867:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681283840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.249962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201328.250027:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681283840 00000100:00100000:0.0:1788201328.250038:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681283840 00000100:00100000:0.0:1788201328.250117:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788201328.250129:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681283840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201328.250190:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681283840:12345-0@lo:400:kworker.0 Request processed in 64us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.250198:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788201328.250249:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681283840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.250384:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681283968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.250429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201328.252029:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681283968 00000100:00100000:0.0:1788201328.252040:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681283968 00000100:00100000:0.0:1788201328.252100:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788201328.252110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681283968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.252132:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681284096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.252187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.252983:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681284096 00000100:00100000:3.0:1788201328.252992:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681284096 00000100:00100000:3.0:1788201328.253034:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788201328.253042:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681284096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.253104:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681284096:12345-0@lo:400:kworker.0 Request processed in 63us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.253112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788201328.253163:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681284096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.253403:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681284224:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.253442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.253469:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201328.253475:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681284352:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.253499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.253527:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681284224 00000100:00100000:3.0:1788201328.253531:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681284224 00000100:00100000:3.0:1788201328.253560:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788201328.253567:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681284224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.253823:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681284224:12345-0@lo:400:kworker.0 Request processed in 254us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.253830:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788201328.253862:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681284224:0@lo:400:kworker.0 00000100:00100000:0.0:1788201328.253891:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681283968:12345-0@lo:400:kworker.0 Request processed in 1782us (3460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.253899:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788201328.253929:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681284352 00000100:00100000:0.0:1788201328.253933:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681284352 00000100:00100000:1.0:1788201328.253973:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681283968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201328.253987:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788201328.253997:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681284352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.254086:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681284352:12345-0@lo:400:kworker.0 Request processed in 91us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.254094:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788201328.254252:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681284736:0@lo:400:kworker.0 00000100:00100000:0.0:1788201328.254290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201328.254322:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681284352:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.254328:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681284736 00000100:00100000:2.0:1788201328.254334:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681284736 00000100:00100000:0.0:1788201328.254336:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201328.254343:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681284864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201328.254374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201328.254385:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788201328.254395:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681284736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.254420:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681284608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.254464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.254482:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681285120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.254502:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.254519:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201328.254524:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681284480:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.254544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.254557:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681284992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.254575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.254840:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681284864 00000100:00100000:3.0:1788201328.254844:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681284864 00000100:00100000:3.0:1788201328.254872:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681284608 00000100:00100000:3.0:1788201328.254874:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681284608 00000100:00100000:3.0:1788201328.254884:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681284480 00000100:00100000:3.0:1788201328.254886:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681284480 00000100:00100000:3.0:1788201328.254896:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681284992 00000100:00100000:3.0:1788201328.254898:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681284992 00000100:00100000:3.0:1788201328.254910:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788201328.254916:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681284864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.255193:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681285120 00000100:00100000:1.0:1788201328.255198:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681285120 00000100:00100000:1.0:1788201328.255234:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788201328.255241:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681285120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.255285:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681285120:12345-0@lo:400:kworker.0 Request processed in 45us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.255291:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788201328.255321:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788201328.255476:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681284608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.255693:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681284736:12345-0@lo:400:kworker.0 Request processed in 1299us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.255701:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201328.255770:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681284608:12345-0@lo:400:kworker.0 Request processed in 326us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.255779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788201328.255808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788201328.255816:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681284480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.255853:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681284864:12345-0@lo:400:kworker.0 Request processed in 935us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.255861:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788201328.255861:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681284736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.255875:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788201328.255883:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681284992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201328.255885:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681284864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201328.255942:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681284992:12345-0@lo:400:kworker.0 Request processed in 60us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.255949:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00080000:3.0:1788201328.255981:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf841c6a00 x1875064681284992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201328.255999:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681284992:0@lo:400:kworker.0 00010000:00080000:3.0:1788201328.256014:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf841c5c00 x1875064681284608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201328.256024:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681284608:0@lo:400:kworker.0 00000100:00080000:2.0:1788201328.256037:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201328.256038:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681285120:0@lo:400:kworker.0 00000100:00080000:2.0:1788201328.256046:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201328.256058:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201328.256061:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201328.256137:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681284480:12345-0@lo:400:kworker.0 Request processed in 322us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.256145:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788201328.256546:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681284480:0@lo:400:kworker.0 00000040:00080000:0.0:1788201328.440827:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788201328.758471:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681285248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201328.758599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.762059:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681285248 00000100:00100000:3.0:1788201328.762080:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681285248 00000100:00100000:3.0:1788201328.762238:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788201328.762251:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba53bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681285248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201328.762286:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788201328.762421:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba53bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681285248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (3821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.762429:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788201328.762872:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681285248:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201328.823908:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201328.835033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.835089:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.835117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.835174:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.835186:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662352384 00000100:00100000:2.0:1788201328.835199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201328.835222:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662352384 00000100:00100000:2.0:1788201328.835235:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662352128 00000100:00100000:2.0:1788201328.835246:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662352128 00000100:00100000:2.0:1788201328.835307:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662352640 00000100:00100000:2.0:1788201328.835311:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662352640 00000100:00100000:1.0:1788201328.835320:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:1.0:1788201328.835336:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662352384:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201328.835357:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662352256 00000100:00100000:2.0:1788201328.835362:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662352256 00000100:00100000:2.0:1788201328.835389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 316 00000100:00100000:2.0:1788201328.835401:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+23:2398:x1875064662352128:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201328.835447:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662352384:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.835457:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:2.0:1788201328.835485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+23:2398:x1875064662352128:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 83us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.835495:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 316 00000100:00100000:1.0:1788201328.835513:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 317 00000100:00100000:2.0:1788201328.835530:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 318 00000100:00100000:1.0:1788201328.835532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662352640:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201328.835547:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662352256:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201328.835578:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662352256:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.835585:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 318 00000100:00080000:2.0:1788201328.835604:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201328.835623:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201328.835650:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.835718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201328.835732:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662352768 00000100:00100000:2.0:1788201328.835781:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662352768 00000100:00100000:1.0:1788201328.835939:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662352640:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 413us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.835948:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 317 00000100:00100000:1.0:1788201328.835978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 319 00000100:00100000:1.0:1788201328.835989:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662352768:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201328.836021:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662352768:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 34us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.836022:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662352000 00000100:00100000:0.0:1788201328.836031:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662352000 00000100:00100000:1.0:1788201328.836037:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 319 00000100:00080000:2.0:1788201328.836105:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201328.839449:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 387 00000100:00100000:0.0:1788201328.839470:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2398:x1875064662352000:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201328.839556:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2398:x1875064662352000:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 94us (4381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.839566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 387 00000100:00100000:1.0:1788201328.839610:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662352512 00000100:00100000:1.0:1788201328.839624:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662352512 00000100:00100000:1.0:1788201328.839715:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:1.0:1788201328.839726:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662352512:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201328.839894:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662352512:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 170us (4242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.839902:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00080000:2.0:1788201328.846759:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788201329.612421:0:14755:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201329.612431:0:14755:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201329.612465:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788201329.612473:0:14755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788201329.770103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201329.770190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662353024 00000100:00100000:0.0:1788201329.770266:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662353024 00000100:00100000:0.0:1788201329.770378:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 202 00000100:00100000:0.0:1788201329.770389:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+23:12398:x1875064662353024:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201329.770432:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201329.770456:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee44720fab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.770570:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee44720fb2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.770585:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee44720fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.770597:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee44720fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201329.770608:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788201329.770704:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee44720fab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f0 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.770721:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee44720fb2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f0 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.770730:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201329.770732:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788201329.770802:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367c200, rc 0) 00000100:00100000:0.0:1788201329.770862:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+25:12398:x1875064662353024:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 475us (767us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788201329.770870:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 202 00000100:00100000:3.0:1788201329.774571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201329.774806:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662353152 00000100:00100000:3.0:1788201329.774816:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662353152 00000100:00100000:3.0:1788201329.774866:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00100000:3.0:1788201329.774876:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+25:12398:x1875064662353152:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:3.0:1788201329.774949:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.774964:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.774989:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775006:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775014:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775021:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775099:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775108:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775114:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201329.775159:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775173:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775179:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.775186:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776303:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201329.776308:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776315:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776329:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201329.776332:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201329.776336:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776343:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776358:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776364:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776371:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776377:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201329.776380:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776386:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776408:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201329.776410:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201329.776413:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776487:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776505:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776511:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776517:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776521:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201329.776524:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776529:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776537:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193a200) 00010000:00010000:3.0:1788201329.776539:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201329.776541:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.776546:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201329.776650:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+25:12398:x1875064662353152:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 1772us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.776659:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00080000:2.0:1788201329.778670:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201329.814429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201329.814554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662353408 00000100:00100000:3.0:1788201329.814564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662353408 00000100:00100000:3.0:1788201329.814663:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:3.0:1788201329.814674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+25:12401:x1875064662353408:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201329.814693:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201329.814714:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720fd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.814834:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.814849:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.814862:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.814878:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.814886:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.814893:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815021:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815030:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815037:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201329.815047:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788201329.815124:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815132:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815139:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815145:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201329.815150:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815157:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815169:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201329.815172:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201329.815177:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815195:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44720fdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815211:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815218:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815224:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815229:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201329.815232:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815239:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815248:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00010000:00010000:3.0:1788201329.815251:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201329.815253:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815259:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44720fe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815299:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720fd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815313:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.815329:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201329.815332:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201329.815334:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbc00, rc 0) 00000100:00100000:3.0:1788201329.815403:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+27:12401:x1875064662353408:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 731us (983us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788201329.815411:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:0.0:1788201329.823399:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201329.823536:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662353536 00000100:00100000:3.0:1788201329.823548:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662353536 00000100:00100000:3.0:1788201329.823618:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 205 00000100:00100000:3.0:1788201329.823630:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+27:12401:x1875064662353536:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:3.0:1788201329.823708:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823726:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823773:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823825:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823833:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823840:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823846:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201329.823866:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823874:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823886:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201329.823890:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201329.823894:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.823910:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44720ff8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201329.823987:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+27:12401:x1875064662353536:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 358us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.823995:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 205 00000100:00100000:1.0:1788201329.827532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201329.827671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662353792 00000100:00100000:2.0:1788201329.827680:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662353792 00000100:00100000:2.0:1788201329.827881:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:2.0:1788201329.827895:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+27:12401:x1875064662353792:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201329.828301:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+28:12401:x1875064662353792:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 408us (777us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788201329.828310:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00010000:00010000:1.0:1788201329.845973:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201329.884887:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201329.885048:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662354048 00000100:00100000:3.0:1788201329.885058:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662354048 00000100:00100000:3.0:1788201329.885118:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 206 00000100:00100000:3.0:1788201329.885128:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+28:11925:x1875064662354048:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201329.885154:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201329.885175:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720fff lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc2fe expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.885492:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.885507:0:10723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.885528:0:10723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.885563:0:10723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.886708:0:10723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 29 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201329.886750:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681285376:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201329.886992:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201329.890511:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681285376:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201329.890557:0:10723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201329.895569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201329.899873:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662354176 00000100:00100000:3.0:1788201329.899887:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662354176 00010000:00010000:3.0:1788201329.899939:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 30 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201329.899991:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 95 00000100:00100000:3.0:1788201329.900002:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:2398:x1875064662354176:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201329.900018:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201329.900026:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 30 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.900039:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 30 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.900061:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44720fea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f7 expref: 30 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.900096:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201329.900102:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.900111:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.900119:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.900881:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201329.900957:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+29:2398:x1875064662354176:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 955us (5397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.900967:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 95 00010000:00010000:0.0:1788201329.906074:0:10723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.906101:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201329.906127:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788201329.906281:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44720fff lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 30 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.906306:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 29 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.906315:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:0.0:1788201329.906318:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788201329.906321:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:0.0:1788201329.906437:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+29:11925:x1875064662354048:12345-192.168.203.2@tcp:101:bash.0 Request processed in 21310us (21558us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788201329.906447:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 206 00000100:00100000:0.0:1788201329.911473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201329.911588:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662354304 00000100:00100000:3.0:1788201329.911599:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662354304 00000100:00100000:3.0:1788201329.911706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 207 00000100:00100000:3.0:1788201329.911718:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+29:11925:x1875064662354304:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201329.911774:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201329.911806:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721014 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.911843:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472101b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.911857:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472101b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.911869:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472101b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.911987:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721014 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc305 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.912006:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472101b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc305 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.912015:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201329.912018:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201329.912021:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201329.912094:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:11925:x1875064662354304:12345-192.168.203.2@tcp:101:bash.0 Request processed in 378us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.912102:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 207 00000100:00100000:2.0:1788201329.916504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201329.916856:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662354560 00000100:00100000:3.0:1788201329.916865:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662354560 00000100:00100000:3.0:1788201329.916969:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 208 00000100:00100000:3.0:1788201329.916980:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+30:11925:x1875064662354560:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:3.0:1788201329.917204:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.917221:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.917233:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201329.917278:0:6515:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1788201329.917303:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c3eab14 reply state 0000000040ff44ac transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.917337:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.917344:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201329.917347:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201329.917351:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788201329.917425:0:6515:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1788201329.917541:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+34:11925:x1875064662354560:12345-192.168.203.2@tcp:36:bash.0 Request processed in 562us (1044us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788201329.917549:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 208 00000020:00080000:3.0:1788201329.917556:0:6515:0:(tgt_main.c:807:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788201329.919535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201329.919602:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662354688 00000100:00100000:0.0:1788201329.919612:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662354688 00000100:00100000:0.0:1788201329.919710:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 209 00000100:00100000:0.0:1788201329.919718:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+34:11925:x1875064662354688:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1788201329.919809:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201329.919831:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44721029 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc30c expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.919889:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44721029 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc30c expref: 35 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.919904:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44721029 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc30c expref: 35 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.919933:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:0.0:1788201329.919937:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201329.919942:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367cc00, rc 0) 00000100:00100000:0.0:1788201329.919999:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+35:11925:x1875064662354688:12345-192.168.203.2@tcp:101:bash.0 Request processed in 281us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201329.920007:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 209 00000100:00100000:1.0:1788201329.927689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201329.927966:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662354816 00000100:00100000:2.0:1788201329.927976:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662354816 00000100:00100000:2.0:1788201329.928075:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:2.0:1788201329.928096:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:11925:x1875064662354816:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201329.928115:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201329.928138:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc313 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201329.928165:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a95c96e, atime: 0x6a95c96c, ctime: 0x6a95c96e, blocks: 0x8 00010000:00010000:2.0:1788201329.928186:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1788201329.928191:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201329.928214:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.928230:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.928244:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1a00, rc 0) 00000100:00100000:2.0:1788201329.928309:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:11925:x1875064662354816:12345-192.168.203.2@tcp:101:bash.0 Request processed in 224us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201329.928316:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:3.0:1788201329.930938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201329.931105:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662354944 00000100:00100000:0.0:1788201329.931115:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662354944 00002000:00010000:0.0:1788201329.931157:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788201329.931162:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf8410dc00 with x1875064662354944 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201329.931173:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf8410dc00. 00000100:00100000:0.0:1788201329.931211:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:0.0:1788201329.931221:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662354944:12345-192.168.203.2@tcp:10:bash.0 00002000:00010000:0.0:1788201329.931507:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788201329.931511:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788201326 -> 1788201329 00002000:00010000:0.0:1788201329.931515:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788201324 -> 1788201324 00002000:00010000:0.0:1788201329.931539:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788201326 -> 1788201329 00002000:00010000:0.0:1788201329.931542:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788201329.931615:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2399:x1875064662354944:12345-192.168.203.2@tcp:10:bash.0 Request processed in 396us (685us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788201329.931624:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00002000:00010000:0.0:1788201329.931627:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788201329.931630:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf8410dc00 with x1875064662354944 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201329.931635:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf8410dc00. 00000100:00100000:3.0:1788201330.014305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.014417:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662355072 00000100:00100000:0.0:1788201330.014426:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662355072 00000100:00100000:0.0:1788201330.014520:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 210 00000100:00100000:0.0:1788201330.014530:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+35:12415:x1875064662355072:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:0.0:1788201330.014608:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014624:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014635:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014649:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014655:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014661:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014829:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014839:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014846:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201330.014886:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014895:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014900:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014905:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014909:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ce00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201330.014912:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014917:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014927:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201330.014930:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201330.014934:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014948:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721037 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014963:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014969:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014975:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014981:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201330.014984:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.014991:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015004:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ce0b25e5b00) 00010000:00010000:0.0:1788201330.015007:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201330.015010:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015017:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472103e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015032:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015038:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015052:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015057:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201330.015064:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015071:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015079:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:0.0:1788201330.015082:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201330.015085:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.015091:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721045 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201330.015273:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+35:12415:x1875064662355072:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 742us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.015282:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 210 00000100:00100000:1.0:1788201330.067051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201330.067211:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662355328 00000100:00100000:3.0:1788201330.067222:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662355328 00000100:00100000:3.0:1788201330.067319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 211 00000100:00100000:3.0:1788201330.067330:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+35:12418:x1875064662355328:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201330.067352:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201330.067375:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee4472104c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc31a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067539:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067551:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067560:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067595:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067603:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067610:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067881:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44721061 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067892:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44721061 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067900:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44721061 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201330.067909:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788201330.067984:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.067993:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068074:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068082:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201330.068086:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068105:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068116:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201330.068119:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.068123:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068130:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721053 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068146:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068152:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068157:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068162:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201330.068165:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068170:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068177:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00010000:00010000:3.0:1788201330.068179:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.068182:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068197:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee4472105a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068243:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee4472104c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc31a expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068256:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44721061 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc31a expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.068264:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201330.068267:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788201330.068269:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba600, rc 0) 00000100:00100000:3.0:1788201330.068328:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+37:12418:x1875064662355328:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1001us (1289us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788201330.068335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 211 00000100:00100000:2.0:1788201330.072968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.073053:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662355456 00000100:00100000:0.0:1788201330.073062:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662355456 00000100:00100000:0.0:1788201330.073124:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 212 00000100:00100000:0.0:1788201330.073141:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+37:12418:x1875064662355456:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:0.0:1788201330.073212:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.073229:0:10723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 37 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.073257:0:10723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.073291:0:10723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 37 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.073305:0:10723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 37 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201330.073321:0:10723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681285504:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201330.073457:0:10723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08356b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201330.081623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.081699:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662355712 00000100:00100000:1.0:1788201330.081719:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662355712 00000100:00100000:0.0:1788201330.081788:0:10723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10723:1875064681285504:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201330.081815:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00010000:00010000:0.0:1788201330.081818:0:10723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201330.081828:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+38:6169:x1875064662355712:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788201330.082726:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+39:6169:x1875064662355712:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 897us (1107us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788201330.082761:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:2.0:1788201330.085304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.085552:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662355840 00000100:00100000:1.0:1788201330.085561:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662355840 00010000:00010000:1.0:1788201330.085730:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 39 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201330.085849:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 96 00000100:00100000:1.0:1788201330.085859:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+39:2398:x1875064662355840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201330.085876:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201330.085882:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 39 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.085895:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 39 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.085917:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44721006 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2fe expref: 39 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.085967:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:1.0:1788201330.085973:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.085981:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.085988:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.086021:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201330.086094:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+38:2398:x1875064662355840:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 236us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.086101:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 96 00010000:00010000:0.0:1788201330.086466:0:10723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.086476:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.086517:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.086525:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.086532:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.086547:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201330.086551:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.086557:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.086567:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:0.0:1788201330.086570:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201330.086574:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.086580:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee4472106f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201330.086639:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+37:12418:x1875064662355456:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 13502us (14039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.086648:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 212 00000100:00100000:2.0:1788201330.089566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.090043:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662356096 00000100:00100000:0.0:1788201330.090053:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662356096 00000100:00100000:0.0:1788201330.090106:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:0.0:1788201330.090269:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+37:12418:x1875064662356096:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1788201330.091658:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+38:12418:x1875064662356096:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 1533us (2090us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788201330.091672:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:2.0:1788201330.185573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.185666:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662356352 00000100:00100000:0.0:1788201330.185677:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662356352 00000100:00100000:0.0:1788201330.185763:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 213 00000100:00100000:0.0:1788201330.185797:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+38:12429:x1875064662356352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1788201330.185822:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201330.185843:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721076 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc321 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.185917:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.185931:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.185943:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.185957:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.185973:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.185981:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186086:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472108b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186095:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472108b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186103:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472108b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201330.186123:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788201330.186194:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186201:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186206:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186211:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201330.186215:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186221:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186231:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201330.186234:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201330.186237:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186242:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee4472107d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186253:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186259:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186273:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186278:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ce00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201330.186281:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186287:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186294:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ce0b25e5b00) 00010000:00010000:0.0:1788201330.186296:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201330.186298:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186303:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee44721084 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186340:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721076 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc321 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186352:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472108b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc321 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.186359:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:0.0:1788201330.186360:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201330.186363:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d400, rc 0) 00000100:00100000:0.0:1788201330.186427:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+40:12429:x1875064662356352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 634us (861us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788201330.186443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 213 00000100:00100000:3.0:1788201330.195459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.195827:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662356608 00000100:00100000:1.0:1788201330.195837:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662356608 00000100:00100000:1.0:1788201330.195949:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:1.0:1788201330.195959:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+40:12429:x1875064662356608:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1788201330.196461:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+41:12429:x1875064662356608:12345-192.168.203.2@tcp:35:cat.0 Request processed in 501us (1009us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788201330.196469:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:2.0:1788201330.224557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201330.224638:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662356864 00000100:00100000:3.0:1788201330.224648:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662356864 00000100:00100000:3.0:1788201330.224705:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 214 00000100:00100000:3.0:1788201330.224714:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+41:12430:x1875064662356864:12345-192.168.203.2@tcp:36:rm.0 00010000:00010000:3.0:1788201330.224803:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788201330.224831:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee44721029 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc30c expref: 41 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224851:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee4472108b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc321 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224884:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee44721061 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc31a expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224897:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472101b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc305 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224907:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201330.224911:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201330.224930:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224942:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224950:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224963:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224969:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.224976:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.225046:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.225053:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.225066:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201330.225913:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788201330.225924:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410523184580ns, next at 411523181911ns, rc = 0 00010000:00010000:3.0:1788201330.225978:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.225989:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.225998:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226006:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226012:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226018:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226041:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201330.226063:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226069:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226075:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226088:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201330.226092:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226101:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226112:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:3.0:1788201330.226115:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201330.226118:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226123:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee447210a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226150:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226156:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226161:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226166:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201330.226169:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226174:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226193:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:3.0:1788201330.226195:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.226198:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226204:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721099 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201330.226213:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097b4066c reply state 00000000a31ba8e3 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226222:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.226229:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00010000:00010000:3.0:1788201330.226231:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201330.226233:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201330.226317:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+39:12430:x1875064662356864:12345-192.168.203.2@tcp:36:rm.0 Request processed in 1602us (1767us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788201330.226326:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 214 00010000:00010000:2.0:1788201330.226521:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201330.226528:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.226535:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201330.226539:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.226545:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.226555:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:2.0:1788201330.226557:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201330.226567:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.226573:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447210ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.226585:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.226586:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.226588:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201330.275112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.275448:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662357120 00000100:00100000:0.0:1788201330.275459:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662357120 00000100:00100000:0.0:1788201330.275526:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 215 00000100:00100000:0.0:1788201330.275537:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+39:12436:x1875064662357120:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1788201330.275563:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201330.275586:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447210b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc328 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.275703:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.275718:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.275729:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.275795:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.275805:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.275811:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201330.276137:0:10723:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788201330.276278:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276302:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276310:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276346:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276355:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276362:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276370:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201330.276374:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276382:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276394:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201330.276397:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201330.276402:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276409:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201330.276421:0:10723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b383a815 reply state 00000000d7b87b50 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276439:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276446:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00010000:00010000:0.0:1788201330.276448:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201330.276451:0:10723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201330.276481:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447210b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 42 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276497:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 41 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.276505:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ce0b25e5b00) 00010000:00010000:0.0:1788201330.276507:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201330.276510:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367c800, rc 0) 00000100:00100000:0.0:1788201330.276572:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+42:12436:x1875064662357120:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1037us (1469us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788201330.276580:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 215 00000100:00100000:0.0:1788201330.284855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.284945:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662357248 00000100:00100000:1.0:1788201330.284954:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662357248 00000100:00100000:1.0:1788201330.285014:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:1.0:1788201330.285024:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662357248:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201330.285041:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201330.285071:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc32f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201330.285096:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201330.285114:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1788201330.285118:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201330.285127:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.285146:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.285159:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255400, rc 0) 00000100:00100000:1.0:1788201330.285218:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662357248:12345-192.168.203.2@tcp:101:bash.0 Request processed in 196us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.285225:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00080000:2.0:1788201330.285298:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201330.288055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.288154:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662357376 00000100:00100000:1.0:1788201330.288164:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662357376 00000100:00100000:1.0:1788201330.288220:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:1.0:1788201330.288232:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+8:12436:x1875064662357376:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201330.288249:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201330.288268:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc336 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.288300:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.288328:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201330.288333:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201330.288339:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.288375:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.288388:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201330.288403:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875064681285632:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201330.288542:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823c8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201330.294095:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681285760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201330.294173:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201330.294284:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681285760 00000100:00100000:2.0:1788201330.294293:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681285760 00000100:00100000:2.0:1788201330.294345:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788201330.294355:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681285760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201330.294390:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201330.294446:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681285760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.294453:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788201330.294611:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681285760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201330.294957:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681285888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201330.294990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201330.295068:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681285888 00000100:00100000:2.0:1788201330.295073:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681285888 00000100:00100000:2.0:1788201330.295107:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788201330.295114:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681285888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201330.295137:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788201330.295178:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681285888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.295185:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788201330.295217:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681285888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201330.295909:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875064681285632:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201330.295935:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.295957:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201330.296016:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+9:12436:x1875064662357376:12345-192.168.203.2@tcp:101:bash.0 Request processed in 7786us (7969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.296024:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:0.0:1788201330.307220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201330.307324:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662357504 00000100:00100000:2.0:1788201330.307334:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662357504 00010000:00010000:2.0:1788201330.307375:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.307426:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:2.0:1788201330.307437:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2398:x1875064662357504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201330.307453:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201330.307477:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.307493:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.307526:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c32d69e3/0xf9b71aee447210d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc32f expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.307545:0:13184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201330.307551:0:13184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201330.307561:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.307572:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.307836:0:13184:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.307867:0:13184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13184:1875064681286016:192.168.203.2@tcp:105: 00000100:00100000:2.0:1788201330.307953:0:13184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201330.312577:0:13184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13184:1875064681286016:192.168.203.2@tcp:105: 00010000:00010000:0.0:1788201330.312618:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201330.312691:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662357504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5255us (5479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.312703:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:1.0:1788201330.313480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.313883:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662357760 00000100:00100000:0.0:1788201330.313906:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662357760 00000100:00100000:0.0:1788201330.314005:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1788201330.314015:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+42:12436:x1875064662357760:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:0.0:1788201330.314368:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+43:12436:x1875064662357760:12345-192.168.203.2@tcp:35:bash.0 Request processed in 354us (890us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788201330.314377:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:3.0:1788201330.517419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.517543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662357888 00000100:00100000:0.0:1788201330.517553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662357888 00000100:00100000:0.0:1788201330.517630:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 216 00000100:00100000:0.0:1788201330.517642:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+43:12452:x1875064662357888:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201330.517668:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201330.517690:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc33d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.517790:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447210ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.517805:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447210ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.517818:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447210ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201330.517863:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788201330.517867:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201330.517887:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447210ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.518164:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447210e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc33d expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.518203:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447210ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc33d expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.518212:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201330.518215:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201330.518218:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d400, rc 0) 00000100:00100000:0.0:1788201330.518283:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+44:12452:x1875064662357888:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 643us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.518291:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 216 00000100:00100000:3.0:1788201330.527704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201330.527957:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662358144 00000100:00100000:2.0:1788201330.527967:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662358144 00000100:00100000:2.0:1788201330.528027:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 217 00000100:00100000:2.0:1788201330.528042:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+44:12452:x1875064662358144:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201330.528063:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201330.528084:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee447210f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc344 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.528193:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447210fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.528206:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447210fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.528218:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447210fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201330.528230:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788201330.528336:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee447210f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc344 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.528354:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447210fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc344 expref: 46 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.528361:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ce0b25e5b00) 00010000:00010000:2.0:1788201330.528376:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201330.528380:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0000, rc 0) 00000100:00100000:2.0:1788201330.528443:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+46:12452:x1875064662358144:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 407us (747us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788201330.528451:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 217 00000100:00100000:1.0:1788201330.532171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.532218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201330.532387:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662358400 00000100:00100000:3.0:1788201330.532396:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662358400 00000100:00100000:3.0:1788201330.532454:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 218 00000100:00100000:3.0:1788201330.532464:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+46:12452:x1875064662358400:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201330.532488:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201330.532509:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721109 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc34b expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.532656:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721110 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.532670:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721110 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.532681:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721110 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201330.532693:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788201330.532827:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721109 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc34b expref: 49 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.532847:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721110 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc34b expref: 48 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.532855:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ce0b25e5b00) 00010000:00010000:3.0:1788201330.532858:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788201330.532861:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba200, rc 0) 00000100:00100000:3.0:1788201330.533095:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+48:12452:x1875064662358400:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 631us (932us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788201330.533104:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 218 00000100:00100000:2.0:1788201330.533449:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662358528 00000100:00100000:2.0:1788201330.533456:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662358528 00000100:00100000:2.0:1788201330.533494:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:2.0:1788201330.533503:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+48:2399:x1875064662358528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201330.533524:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201330.533542:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee447210fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc344 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.533555:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ce0b25e5b00) 00010000:00010000:2.0:1788201330.533559:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201330.533830:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+47:2399:x1875064662358528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 326us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.533837:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:3.0:1788201330.544884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.546950:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662358656 00000100:00100000:1.0:1788201330.546963:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662358656 00000100:00100000:1.0:1788201330.547032:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:1.0:1788201330.547042:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf83711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2401:x1875064662358656:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1788201330.547085:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.547105:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.547114:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201330.547118:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201330.547122:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.547159:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.547171:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 8 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201330.547205:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875064681286144:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201330.547305:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201330.556360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.556360:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875064681286144:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201330.556392:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.556474:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662358784 00000100:00100000:2.0:1788201330.556482:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662358784 00002000:00100000:2.0:1788201330.556540:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ce0bf510a80 x1875064662358784/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:451/0 lens 504/0 e 0 to 0 dl 1788201341 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201330.556551:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ce0bf510a80 with x1875064662358784 ext(0->8) 00010000:00010000:2.0:1788201330.556558:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 9 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.556573:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 9 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201330.556599:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ce0bf510a80 00000100:00100000:2.0:1788201330.556630:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1788201330.556642:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2399:x1875064662358784:12345-192.168.203.2@tcp:4:lfs.0 00000100:00100000:3.0:1788201330.558909:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2399:x1875064662358784:12345-192.168.203.2@tcp:4:lfs.0 Request processed in 2259us (2550us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788201330.558924:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00002000:00100000:3.0:1788201330.558946:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ce0bf510a80 x1875064662358784/t4294967309(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:451/0 lens 504/448 e 0 to 0 dl 1788201341 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201330.558956:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ce0bf510a80 with x1875064662358784 ext(0->8) 00010000:00010000:3.0:1788201330.558966:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 11 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.558984:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 11 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.558992:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ce0bf510a80 00000001:00080000:0.0:1788201330.559989:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788201330.560006:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788201330.563253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.563436:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662358912 00000100:00100000:1.0:1788201330.563445:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662358912 00010000:00010000:1.0:1788201330.563485:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 7 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201330.563587:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 98 00000100:00100000:1.0:1788201330.563598:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662358912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201330.563613:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788201330.563631:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788201330.563634:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788201329 00002000:00010000:1.0:1788201330.563636:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788201329 00002000:00010000:1.0:1788201330.563648:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788201329 00002000:00010000:1.0:1788201330.563651:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788201330.563657:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 7 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.564132:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 7 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.564176:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c14d9b0c/0xf9b71aee447210df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc336 expref: 7 pid: 8430 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.564192:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201330.564196:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201330.564201:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.564210:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.564235:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201330.564300:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+6:2400:x1875064662358912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 704us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.564308:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 98 00010000:00010000:0.0:1788201330.565137:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.565149:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.565177:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.565186:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.565194:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.565212:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201330.565217:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.565226:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.565239:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.565246:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472111e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201330.565315:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf83711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662358656:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 18274us (20439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.565321:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:0.0:1788201330.569026:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201330.569108:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662359168 00000100:00100000:3.0:1788201330.569117:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662359168 00000100:00100000:3.0:1788201330.569320:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:3.0:1788201330.569332:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf43850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+47:12452:x1875064662359168:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:3.0:1788201330.569396:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721110 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc34b expref: 47 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201330.569649:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788201330.569684:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788201330.570027:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1788201330.570067:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.570082:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 51 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.570090:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.570135:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 51 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.570149:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 51 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201330.570163:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf510380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875064681286272:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201330.570240:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201330.573156:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf510380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875064681286272:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201330.573188:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201330.575359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201330.575454:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662359296 00000100:00100000:2.0:1788201330.575463:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662359296 00010000:00010000:2.0:1788201330.575502:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 52 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.575551:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:2.0:1788201330.575561:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+52:2399:x1875064662359296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201330.575705:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201330.575715:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 52 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.575728:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 52 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.575797:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee447210ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc328 expref: 52 pid: 10723 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.575812:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ce0b25e5b00) 00010000:00010000:2.0:1788201330.575818:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.575827:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.575845:0:13184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.575867:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201330.575922:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+51:2399:x1875064662359296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 362us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.575930:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 99 00010000:00010000:3.0:1788201330.576020:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.576028:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201330.576134:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788201330.576250:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788201330.576341:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf510380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875064681286400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788201330.576391:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201330.576427:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201330.576916:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681286400 00000100:00100000:2.0:1788201330.576923:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681286400 00000100:00100000:2.0:1788201330.576976:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201330.576985:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875064681286400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788201330.577070:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875064681286400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.577077:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788201330.578207:0:6519:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1788201330.578218:0:6519:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1788201330.578253:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf841b9c00, transno 4294967308 00000100:00100000:3.0:1788201330.578277:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf510380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875064681286400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788201330.578440:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1788201330.578504:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf510380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875064681286528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788201330.578565:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201330.578756:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201330.578931:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201330.579000:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681286528 00000100:00100000:2.0:1788201330.579006:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681286528 00000100:00100000:2.0:1788201330.579055:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788201330.579064:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1875064681286528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788201330.579217:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1875064681286528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 154us (652us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788201330.579225:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788201330.579298:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf510380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875064681286528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788201330.579349:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788201330.579386:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.579396:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.579403:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.579425:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201330.579430:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.579437:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.579452:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ce0b25e5b00) 00010000:00010000:1.0:1788201330.579455:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788201330.579460:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.579466:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44721125 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201330.579703:0:6519:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788201330.579803:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788201330.579815:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410877075889ns, next at 411877073574ns, rc = 0 00000001:00080000:1.0:1788201330.579822:0:6519:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788201330.579846:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ce0b25e5b00) 00010000:00010000:1.0:1788201330.579848:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788201330.579855:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44721110 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc34b expref: 55 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201330.579950:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf43850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+54:12452:x1875064662359168:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 10622us (10934us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788201330.579958:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000020:00080000:1.0:1788201330.579963:0:6519:0:(tgt_main.c:807:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788201330.583849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201330.583972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662359424 00000100:00100000:3.0:1788201330.583981:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662359424 00000100:00100000:3.0:1788201330.584032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 219 00000100:00100000:3.0:1788201330.584041:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+54:12452:x1875064662359424:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201330.584065:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201330.584089:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472112c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc352 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.584147:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472112c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc352 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.584163:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472112c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc352 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.584182:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:3.0:1788201330.584185:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201330.584189:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbc00, rc 0) 00000100:00100000:3.0:1788201330.584236:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+55:12452:x1875064662359424:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 196us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201330.584244:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 219 00000100:00100000:2.0:1788201330.592063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.592165:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662359680 00000100:00100000:0.0:1788201330.592174:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662359680 00000100:00100000:0.0:1788201330.592236:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:0.0:1788201330.592246:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+55:12452:x1875064662359680:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1788201330.592486:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+56:12452:x1875064662359680:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 241us (430us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788201330.592513:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:0.0:1788201330.672660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201330.673247:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662359808 00000100:00100000:3.0:1788201330.673259:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662359808 00000100:00100000:2.0:1788201330.673449:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 220 00000100:00100000:2.0:1788201330.673459:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+56:12462:x1875064662359808:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:2.0:1788201330.673787:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.673821:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.673834:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.673848:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.673856:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.673862:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.673939:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.673947:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.673953:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201330.673999:0:10723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674012:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674018:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674108:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674114:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201330.674118:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674127:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674140:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:2.0:1788201330.674143:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201330.674147:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674153:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721133 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674166:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674172:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674178:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674182:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201330.674185:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674200:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674207:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00010000:00010000:2.0:1788201330.674210:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201330.674213:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674218:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee4472113a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674227:0:10723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674233:0:10723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674239:0:10723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674244:0:10723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201330.674246:0:10723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674252:0:10723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674260:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201330.674262:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201330.674265:0:10723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.674280:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721141 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.674415:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+56:12462:x1875064662359808:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 956us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.674426:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 220 00000100:00100000:3.0:1788201330.734204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.734575:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662360064 00000100:00100000:1.0:1788201330.735376:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662360064 00000100:00100000:1.0:1788201330.735951:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 221 00000100:00100000:1.0:1788201330.735966:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf840a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+56:12465:x1875064662360064:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201330.735988:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201330.736012:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721148 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc359 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736087:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736100:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736113:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736124:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736132:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736138:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736249:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472115d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736436:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472115d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736506:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472115d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201330.736517:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788201330.736811:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736819:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736826:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736899:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201330.736903:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736911:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736923:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:1.0:1788201330.736926:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201330.736930:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736936:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee4472114f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736950:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736956:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736969:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.736974:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201330.736978:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.737034:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.737044:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00010000:00010000:1.0:1788201330.737046:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201330.737049:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.737054:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721156 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.737097:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721148 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc359 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.737111:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472115d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc359 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.737118:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:1.0:1788201330.737120:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201330.737123:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255a00, rc 0) 00000100:00100000:1.0:1788201330.737195:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf840a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+58:12465:x1875064662360064:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1233us (3001us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788201330.737212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 221 00000100:00100000:1.0:1788201330.742431:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201330.742503:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662360192 00000100:00100000:2.0:1788201330.742512:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662360192 00000100:00100000:2.0:1788201330.742582:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 222 00000100:00100000:2.0:1788201330.742592:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+58:12465:x1875064662360192:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:2.0:1788201330.742654:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742671:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742682:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742711:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742718:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742725:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742730:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201330.742734:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742788:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742801:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201330.742804:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201330.742810:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.742816:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee4472116b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.742894:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+58:12465:x1875064662360192:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 299us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.742903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 222 00000100:00100000:0.0:1788201330.752881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201330.753133:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662360448 00000100:00100000:2.0:1788201330.753143:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662360448 00000100:00100000:2.0:1788201330.753248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:2.0:1788201330.753269:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+58:12465:x1875064662360448:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201330.753501:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+59:12465:x1875064662360448:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 243us (630us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788201330.753516:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:1.0:1788201330.806569:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201330.806592:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681286784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201330.806661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201330.806706:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201330.806720:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681286656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201330.806763:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681286784 00000100:00100000:1.0:1788201330.806770:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681286784 00000100:00100000:0.0:1788201330.806788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201330.806833:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201330.806844:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681286656 00000100:00100000:1.0:1788201330.806849:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681286656 00000100:00080000:0.0:1788201330.806868:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201330.806874:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788201330.806883:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681286784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201330.806918:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788201330.806967:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681286784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.806975:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788201330.806993:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788201330.807000:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681286656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201330.807010:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788201330.807037:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681286656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.807106:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681286784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201330.807139:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681286656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201330.807511:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201330.865217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201330.865342:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662360704 00000100:00100000:2.0:1788201330.865355:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662360704 00000100:00100000:2.0:1788201330.866428:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 223 00000100:00100000:2.0:1788201330.866440:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+59:12475:x1875064662360704:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201330.866465:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201330.866468:0:10723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201330.866510:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d400/0xf9b71aee447210ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc33d expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.866541:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:2.0:1788201330.866546:0:10723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201330.866560:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721172 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc360 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.867065:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721179 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.867565:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721179 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.867646:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721179 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201330.867663:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788201330.867811:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721172 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc360 expref: 61 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.867828:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721179 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc360 expref: 60 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.867837:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201330.867839:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201330.867842:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0000, rc 0) 00000100:00100000:2.0:1788201330.867911:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+60:12475:x1875064662360704:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1472us (2703us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788201330.867919:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 223 00010000:00010000:1.0:1788201330.870193:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201330.876959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201330.877047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.877188:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662360960 00000100:00100000:1.0:1788201330.877197:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662360960 00000100:00100000:1.0:1788201330.877264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00100000:1.0:1788201330.877276:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+60:12475:x1875064662360960:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1788201330.877321:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788201330.877330:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662360832 00000100:00100000:2.0:1788201330.877337:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662360832 00010000:00010000:1.0:1788201330.877345:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721187 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc367 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.877380:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00010000:00010000:1.0:1788201330.877384:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.877390:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+62:2401:x1875064662360832:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201330.877402:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.877406:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201330.877417:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.877481:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721179 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc360 expref: 62 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.877499:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201330.877503:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201330.877527:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721187 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.877544:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.877552:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:1.0:1788201330.877555:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201330.877558:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255e00, rc 0) 00000100:00100000:2.0:1788201330.877689:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+61:2401:x1875064662360832:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 299us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.877696:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:1.0:1788201330.878852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+60:12475:x1875064662360960:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1572us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.878862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00100000:3.0:1788201330.887951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.888846:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662361216 00000100:00100000:1.0:1788201330.888856:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662361216 00000100:00100000:1.0:1788201330.889006:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 225 00000100:00100000:1.0:1788201330.889018:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+60:12475:x1875064662361216:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:1.0:1788201330.889086:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201330.889113:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee4472115d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc359 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.889131:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:1.0:1788201330.889135:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201330.889316:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.889330:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.889340:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201330.889379:0:8476:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788201330.889401:0:8476:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db18ec94 reply state 00000000a2f0d29f transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.889412:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.889419:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:1.0:1788201330.889421:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201330.889424:0:8476:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201330.889518:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+62:12475:x1875064662361216:12345-192.168.203.2@tcp:36:bash.0 Request processed in 502us (1576us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788201330.889525:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 225 00000020:00080000:1.0:1788201330.889530:0:8476:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788201330.892366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201330.892495:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662361344 00000100:00100000:3.0:1788201330.892505:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662361344 00000100:00100000:3.0:1788201330.892604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 226 00000100:00100000:3.0:1788201330.892614:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+62:12475:x1875064662361344:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201330.892638:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201330.892671:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee4472119c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc36e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.892804:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.892819:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.892830:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201330.892859:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788201330.892864:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201330.892883:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.892910:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba600/0xf9b71aee4472119c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.892929:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.892958:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:3.0:1788201330.892961:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201330.892965:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bae00, rc 0) 00000100:00100000:3.0:1788201330.893029:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12475:x1875064662361344:12345-192.168.203.2@tcp:101:bash.0 Request processed in 416us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201330.893036:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 226 00000100:00100000:0.0:1788201330.899489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.899601:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662361600 00000100:00100000:1.0:1788201330.899624:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662361600 00000100:00100000:1.0:1788201330.899681:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:1.0:1788201330.899691:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+63:12475:x1875064662361600:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:1.0:1788201330.899960:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12475:x1875064662361600:12345-192.168.203.2@tcp:35:bash.0 Request processed in 270us (479us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788201330.899968:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:1.0:1788201330.982270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.982425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662361728 00000100:00100000:0.0:1788201330.982433:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662361728 00000100:00100000:0.0:1788201330.982500:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 227 00000100:00100000:0.0:1788201330.982541:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+64:12481:x1875064662361728:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201330.982565:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201330.982808:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc375 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.982876:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee447211b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.982890:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee447211b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.982901:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee447211b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201330.982963:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788201330.982967:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201330.982986:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee447211b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.983012:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc375 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.983029:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee447211b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc375 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.983039:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201330.983042:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201330.983046:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d800, rc 0) 00000100:00100000:0.0:1788201330.983113:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12481:x1875064662361728:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 603us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.983120:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 227 00000100:00100000:0.0:1788201330.986865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.986919:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662361856 00000100:00100000:1.0:1788201330.986928:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662361856 00000100:00100000:1.0:1788201330.987032:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 228 00000100:00100000:1.0:1788201330.987042:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12481:x1875064662361856:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201330.987065:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201330.987088:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc37c expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987162:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987176:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987187:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987198:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987205:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987231:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987313:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447211cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987322:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447211cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987329:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447211cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201330.987373:0:8476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788201330.987377:0:8476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201330.987395:0:8476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447211cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987407:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447211cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987415:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987421:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987428:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987435:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201330.987439:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987454:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987467:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:1.0:1788201330.987470:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201330.987475:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987481:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee447211bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987496:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987503:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987520:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987526:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201330.987528:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987534:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987543:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00010000:00010000:1.0:1788201330.987546:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201330.987549:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987564:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447211c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987613:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc37c expref: 67 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987626:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447211cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc37c expref: 66 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.987633:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:1.0:1788201330.987635:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201330.987637:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201330.987701:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12481:x1875064662361856:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 661us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.987710:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 228 00000100:00100000:3.0:1788201330.990997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201330.991191:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662361984 00000100:00100000:1.0:1788201330.991200:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662361984 00000100:00100000:1.0:1788201330.991286:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:1.0:1788201330.991299:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+66:2398:x1875064662361984:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201330.991314:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201330.991340:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447211cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc37c expref: 66 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.991359:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:1.0:1788201330.991363:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201330.991417:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+65:2398:x1875064662361984:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 123us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.991438:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1788201330.994727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201330.995072:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662362240 00000100:00100000:0.0:1788201330.995082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662362240 00000100:00100000:0.0:1788201330.995181:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 229 00000100:00100000:0.0:1788201330.995193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12481:x1875064662362240:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201330.995215:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201330.995238:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc383 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.995342:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.995371:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.995381:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.995414:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.995427:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 66 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201330.995442:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681286912:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201330.995545:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201330.998935:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681286912:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201330.998965:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.000231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.000556:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662362368 00000100:00100000:2.0:1788201331.000564:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662362368 00010000:00010000:2.0:1788201331.000619:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 67 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.000654:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00100000:2.0:1788201331.000664:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+67:2400:x1875064662362368:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201331.000679:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201331.000686:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 67 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.000699:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 67 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.000787:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee447211a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc36e expref: 67 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.000807:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201331.000814:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.000824:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.000831:0:13184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.000855:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201331.000916:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+66:2400:x1875064662362368:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 252us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.000923:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 100 00010000:00010000:0.0:1788201331.001422:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.001432:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201331.001452:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788201331.001612:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.001629:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.001638:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201331.001648:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788201331.001651:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367c600, rc 0) 00000100:00100000:0.0:1788201331.001694:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12481:x1875064662362240:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6502us (6976us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788201331.001701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 229 00000100:00100000:3.0:1788201331.004726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.004955:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662362624 00000100:00100000:2.0:1788201331.004964:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662362624 00000100:00100000:2.0:1788201331.005044:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1788201331.005054:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12481:x1875064662362624:12345-192.168.203.2@tcp:103:lfs.0 00000100:00080000:0.0:1788201331.005064:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201331.005070:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201331.005095:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472112c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc352 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.005117:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201331.005122:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201331.005195:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12481:x1875064662362624:12345-192.168.203.2@tcp:103:lfs.0 Request processed in 142us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.005203:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1788201331.012112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.012809:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662362752 00000100:00100000:0.0:1788201331.012820:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662362752 00000100:00100000:0.0:1788201331.012884:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 230 00000100:00100000:0.0:1788201331.012894:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12481:x1875064662362752:12345-192.168.203.2@tcp:58:lfs.0 00010000:00010000:0.0:1788201331.013002:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.013019:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.013030:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201331.013129:0:10723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788201331.013216:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12481:x1875064662362752:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 324us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201331.013224:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 230 00000100:00100000:3.0:1788201331.018609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.018713:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662362880 00000100:00100000:1.0:1788201331.018722:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662362880 00000100:00100000:1.0:1788201331.018827:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 231 00000100:00100000:1.0:1788201331.018837:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+65:12481:x1875064662362880:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201331.018860:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201331.018882:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc38a expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.018939:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.018951:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 66 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.018969:0:8476:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.018982:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 66 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.018995:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:1.0:1788201331.018998:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201331.019002:0:8476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 66 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.019010:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255a00, rc 0) 00000100:00100000:1.0:1788201331.019083:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12481:x1875064662362880:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 248us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.019091:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 231 00000040:00080000:3.0:1788201331.254342:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201331.254351:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201331.254399:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788201331.254409:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788201331.254548:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681287040:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788201331.254672:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201331.259407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.259429:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681287040:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788201331.259562:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662363008 00000100:00100000:1.0:1788201331.259569:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662363008 00000100:00100000:1.0:1788201331.259640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 232 00000100:00100000:1.0:1788201331.259650:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12482:x1875064662363008:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788201331.259681:0:6516:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788201331.259826:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12482:x1875064662363008:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 177us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.259834:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 232 00000100:00100000:1.0:1788201331.275214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.275327:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662363136 00000100:00100000:2.0:1788201331.275338:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662363136 00000100:00100000:2.0:1788201331.275398:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 233 00000100:00100000:2.0:1788201331.275408:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a087d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12482:x1875064662363136:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788201331.275480:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275497:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275510:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275526:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275533:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275540:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275562:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275572:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275612:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201331.275660:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788201331.275664:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201331.275678:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275988:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.275996:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276003:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276009:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201331.276013:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276021:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276033:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:2.0:1788201331.276037:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201331.276042:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276048:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee447211f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276073:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276080:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276087:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276092:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201331.276095:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276101:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276108:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9ce086201100) 00010000:00010000:2.0:1788201331.276111:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201331.276113:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276118:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee447211fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276133:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276140:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276146:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276157:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201331.276160:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276166:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276175:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201331.276177:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201331.276180:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.276186:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721205 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.276575:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a087d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12482:x1875064662363136:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 1165us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.276593:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 233 00000100:00100000:3.0:1788201331.290109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.290294:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662363392 00000100:00100000:0.0:1788201331.290304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662363392 00000100:00100000:0.0:1788201331.290369:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 234 00000100:00100000:0.0:1788201331.290379:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+66:12482:x1875064662363392:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201331.290419:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201331.290440:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee4472120c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc391 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.295293:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.295326:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.295338:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201331.295361:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788201331.295927:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.295937:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.295945:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.295951:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.295956:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.295962:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.295976:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201331.295991:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201331.295997:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.296003:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721213 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.296060:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee4472120c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc391 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.296070:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:0.0:1788201331.296072:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201331.296076:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee4472120c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc391 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.296158:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d200, rc 0) 00000100:00100000:0.0:1788201331.296362:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+67:12482:x1875064662363392:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 5983us (6260us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788201331.296371:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 234 00000100:00100000:3.0:1788201331.300471:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.301462:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662363520 00000100:00100000:2.0:1788201331.301473:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662363520 00000100:00100000:2.0:1788201331.301547:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 235 00000100:00100000:2.0:1788201331.301558:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+67:12482:x1875064662363520:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788201331.301616:0:10723:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788201331.301767:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+67:12482:x1875064662363520:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 183us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.301785:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 235 00000100:00100000:1.0:1788201331.313384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.313514:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662363776 00000100:00100000:2.0:1788201331.313524:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662363776 00000100:00100000:2.0:1788201331.313596:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 236 00000100:00100000:2.0:1788201331.313606:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+67:12482:x1875064662363776:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201331.313626:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201331.313629:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201331.313656:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d800/0xf9b71aee447211b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc375 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.313677:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:2.0:1788201331.313683:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201331.313698:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721221 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc398 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201331.314964:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788201331.315303:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44721228 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.315318:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44721228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.315329:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44721228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.315389:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0000/0xf9b71aee44721221 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc398 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.315407:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44721228 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc398 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.315690:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce086201100) 00010000:00010000:2.0:1788201331.315708:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201331.315712:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1400, rc 0) 00000100:00100000:2.0:1788201331.315828:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+68:12482:x1875064662363776:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2221us (2451us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788201331.315837:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 236 00000100:00100000:3.0:1788201331.328173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.328798:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662364032 00000100:00100000:0.0:1788201331.328808:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662364032 00000100:00100000:0.0:1788201331.328888:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 237 00000100:00100000:0.0:1788201331.328898:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+68:12482:x1875064662364032:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788201331.328957:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201331.328984:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1400/0xf9b71aee44721228 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc398 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329005:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce086201100) 00010000:00010000:0.0:1788201331.329029:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201331.329050:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329063:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329072:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329094:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329102:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329108:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329153:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329160:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329166:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329173:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.329177:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329185:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329216:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:0.0:1788201331.329219:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.329223:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329230:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee44721236 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329240:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329247:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329252:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329258:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.329261:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329267:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329284:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xab2e9425 (ffff9ce0b25e5900) 00010000:00010000:0.0:1788201331.329286:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.329289:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.329295:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472123d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xab2e9425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201331.329378:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+67:12482:x1875064662364032:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 480us (1213us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201331.329385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 237 00000100:00100000:3.0:1788201331.338679:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.339876:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662364160 00000100:00100000:1.0:1788201331.339886:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662364160 00000100:00100000:1.0:1788201331.339954:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 238 00000100:00100000:1.0:1788201331.339965:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+67:12482:x1875064662364160:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201331.339987:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201331.340085:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44721244 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc39f expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.340124:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.340137:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.340149:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.340661:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44721244 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 69 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.341208:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 68 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.341219:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:1.0:1788201331.341222:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201331.341225:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201331.341997:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+68:12482:x1875064662364160:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2022us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.342007:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 238 00000100:00100000:1.0:1788201331.352614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.353070:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662364416 00000100:00100000:2.0:1788201331.353081:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662364416 00000100:00100000:2.0:1788201331.353146:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 239 00000100:00100000:2.0:1788201331.353157:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+68:12482:x1875064662364416:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201331.353240:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.353394:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.353408:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201331.353634:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788201331.353645:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411650905914ns, next at 412650902892ns, rc = 0 00000004:00010000:2.0:1788201331.354083:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1820a84 reply state 00000000bab1e311 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.354099:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.354106:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:2.0:1788201331.354109:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788201331.354112:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201331.354234:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+70:12482:x1875064662364416:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 1077us (1627us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788201331.356096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 239 00000100:00100000:2.0:1788201331.359539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.359877:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662364544 00000100:00100000:0.0:1788201331.359887:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662364544 00000100:00100000:0.0:1788201331.359950:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 240 00000100:00100000:0.0:1788201331.359961:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+70:12482:x1875064662364544:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201331.359987:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201331.360009:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3a6 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.360080:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 71 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.360094:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 71 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.360113:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:0.0:1788201331.360117:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201331.360120:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d600, rc 0) 00000100:00100000:0.0:1788201331.360184:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+71:12482:x1875064662364544:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 225us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201331.360191:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 240 00000100:00100000:3.0:1788201331.365496:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.366150:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662364672 00000100:00100000:2.0:1788201331.366161:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662364672 00000100:00100000:2.0:1788201331.366271:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:2.0:1788201331.366282:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2398:x1875064662364672:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788201331.366482:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+10:2398:x1875064662364672:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 202us (994us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788201331.366490:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:3.0:1788201331.369853:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.370541:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662364928 00000100:00100000:1.0:1788201331.370552:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662364928 00000100:00100000:1.0:1788201331.370627:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:1.0:1788201331.370637:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+71:12482:x1875064662364928:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788201331.371158:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+72:12482:x1875064662364928:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 522us (1313us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788201331.371167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:3.0:1788201331.375030:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.375425:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662365184 00000100:00100000:1.0:1788201331.375434:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662365184 00000100:00100000:1.0:1788201331.375503:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 241 00000100:00100000:1.0:1788201331.375531:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+72:12482:x1875064662365184:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788201331.376196:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+72:12482:x1875064662365184:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 672us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.376218:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 241 00000100:00080000:0.0:1788201331.383717:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201331.383825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.383878:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662365312 00000100:00100000:2.0:1788201331.383889:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662365312 00000100:00100000:2.0:1788201331.383950:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 242 00000100:00100000:2.0:1788201331.383961:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+72:12482:x1875064662365312:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201331.383983:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201331.384007:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721260 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3ad expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.384080:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721267 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.384094:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721267 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.384105:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721267 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201331.384153:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201331.384189:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721267 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.384215:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee44721260 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3ad expref: 74 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.384232:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721267 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3ad expref: 73 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.384241:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:2.0:1788201331.384244:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788201331.384247:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0200, rc 0) 00000100:00100000:2.0:1788201331.384526:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+73:12482:x1875064662365312:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 565us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.384535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 242 00000100:00100000:3.0:1788201331.391075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.391162:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662365440 00000100:00100000:0.0:1788201331.391173:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662365440 00000100:00100000:0.0:1788201331.391516:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:0.0:1788201331.391528:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+10:2398:x1875064662365440:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201331.391620:0:8485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201331.391642:0:8485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3b4 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201331.391668:0:8485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c972, blocks: 0x0 00010000:00010000:0.0:1788201331.391688:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788201331.391699:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201331.391709:0:8485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 11 pid: 8485 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.391727:0:8485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 11 pid: 8485 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.391787:0:8485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d200, rc 0) 00000100:00100000:0.0:1788201331.391860:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2398:x1875064662365440:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 334us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201331.391867:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:2.0:1788201331.399895:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.400018:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662365696 00000100:00100000:1.0:1788201331.400028:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662365696 00000100:00100000:1.0:1788201331.400152:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:1.0:1788201331.400163:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+73:12482:x1875064662365696:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788201331.400277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+73:12482:x1875064662365696:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.400285:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:3.0:1788201331.405279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.405482:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662365824 00000100:00100000:2.0:1788201331.405493:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662365824 00000100:00100000:2.0:1788201331.405568:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:2.0:1788201331.405713:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+11:12482:x1875064662365824:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201331.405735:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201331.405805:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3bb expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.405838:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 12 pid: 8485 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.405848:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201331.405866:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201331.405872:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.405906:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 12 pid: 8485 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.405919:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 12 pid: 8485 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.405935:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875064681287168:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201331.406037:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201331.409719:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875064681287168:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201331.409811:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.409832:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0800, rc 0) 00000100:00100000:2.0:1788201331.409894:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+12:12482:x1875064662365824:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 4317us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.409903:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:3.0:1788201331.411359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.411463:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662365952 00000100:00100000:1.0:1788201331.411475:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662365952 00010000:00010000:1.0:1788201331.411519:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 12 pid: 8485 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.411563:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 101 00000100:00100000:1.0:1788201331.411572:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+12:2399:x1875064662365952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201331.411586:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201331.411606:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 12 pid: 8485 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.411618:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 12 pid: 8485 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.411640:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ed2e7ee/0xf9b71aee4472126e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3b4 expref: 12 pid: 8485 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.411672:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201331.411676:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201331.411685:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.411695:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.412382:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.412400:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1875064681287296:192.168.203.2@tcp:105: 00000100:00100000:1.0:1788201331.412488:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201331.415311:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1875064681287296:192.168.203.2@tcp:105: 00010000:00010000:1.0:1788201331.415346:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201331.415419:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2399:x1875064662365952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3847us (4068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.415431:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 101 00000100:00100000:3.0:1788201331.416712:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.416901:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662366080 00000100:00100000:0.0:1788201331.416911:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662366080 00002000:00100000:0.0:1788201331.416976:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9cdf8333e680 x1875064662366080/t0(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:452/0 lens 504/0 e 0 to 0 dl 1788201342 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201331.416987:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf8333e680 with x1875064662366080 ext(0->12) 00002000:00010000:0.0:1788201331.416993:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf8333e680 00000100:00100000:0.0:1788201331.417052:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1788201331.417081:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+11:2398:x1875064662366080:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788201331.417947:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+13:2398:x1875064662366080:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 Request processed in 864us (1239us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788201331.417959:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00002000:00100000:0.0:1788201331.417969:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9cdf8333e680 x1875064662366080/t4294967322(0) o4->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:452/0 lens 504/448 e 0 to 0 dl 1788201342 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201331.417978:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf8333e680 with x1875064662366080 ext(0->12) 00002000:00010000:0.0:1788201331.417983:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf8333e680 00000100:00100000:2.0:1788201331.421364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.421499:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662366208 00000100:00100000:0.0:1788201331.421511:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662366208 00000100:00100000:0.0:1788201331.421589:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:0.0:1788201331.421602:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+73:12482:x1875064662366208:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788201331.424505:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788201331.424532:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1788201331.424591:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00010000:00010000:0.0:1788201331.424599:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.424615:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788201331.424620:0:6495:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cdf8200a900 refcount 2 committed 0 result 0 batchid 7 00010000:00010000:0.0:1788201331.424625:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788201331.424627:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0b96a8700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cdf8200a780 00000020:00080000:3.0:1788201331.424635:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0b96a8d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cdf833f6600 00010000:00010000:0.0:1788201331.424650:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.424657:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.424668:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201331.424671:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788201331.424706:0:6495:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce0b9696240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788201331.424710:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0ba2be400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce0b9696f00 00000020:00080000:3.0:1788201331.424713:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0ba2be300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cdf84184600 00000020:00080000:3.0:1788201331.424724:0:6495:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1788201331.424733:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:3.0:1788201331.424768:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1788201331.424794:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681287424:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788201331.424873:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1788201331.424878:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ce0b25e5c00) 00010000:00010000:0.0:1788201331.424882:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.424888:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.424890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201331.424899:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee44720f7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.424932:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.424938:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.424943:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.424949:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.424951:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.424954:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788201331.424961:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.424967:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681287552:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788201331.424974:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cdf8193ab00) 00010000:00010000:0.0:1788201331.424979:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.424982:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.424989:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44721022 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.424998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201331.425042:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681287680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201331.425046:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681287424 00010000:00010000:0.0:1788201331.425053:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.425055:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681287424 00010000:00010000:0.0:1788201331.425064:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.425072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201331.425077:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425085:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.425089:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425096:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.425103:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681287552 00010000:00010000:0.0:1788201331.425107:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00000100:00100000:2.0:1788201331.425108:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681287552 00000100:00100000:1.0:1788201331.425112:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681287680 00010000:00010000:0.0:1788201331.425113:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201331.425117:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681287680 00010000:00010000:0.0:1788201331.425118:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425127:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb800/0xf9b71aee447210a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.425129:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1788201331.425147:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.425149:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0c1d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681287424:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201331.425153:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425159:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425170:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ca00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.425173:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425177:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425183:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cdf8193a200) 00010000:00010000:0.0:1788201331.425184:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.425186:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425190:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ca00/0xf9b71aee447210c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788201331.425193:0:8485:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1788201331.425203:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425207:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425211:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425214:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.425216:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425219:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.425223:0:8485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425237:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201331.425239:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.425241:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425244:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721195 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425254:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.425258:0:8485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425258:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425273:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.425284:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788201331.425284:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.425290:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.425293:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201331.425303:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.425304:0:8485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425322:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:0.0:1788201331.425326:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201331.425330:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.425336:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1e00/0xf9b71aee44721252 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.425346:0:8485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.425364:0:8485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 12 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.425377:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8485:1875064681287808:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201331.425455:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201331.425462:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+21:12482:x1875064662366208:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 3858us (4107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201331.425472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:2.0:1788201331.425687:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201331.425697:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681287552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788201331.425848:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788201331.425852:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788201330 00002000:00010000:2.0:1788201331.425855:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788201331.425857:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788201330 -> 1788201330 00002000:00010000:2.0:1788201331.425866:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788201331.425914:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3645:x1875064681287552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (915us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788201331.425921:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201331.425936:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201331.425943:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681287680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201331.425957:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1788201331.425981:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a95c971, atime: 0x6a95c971, ctime: 0x6a95c971, blocks: 0x8 00010000:00010000:2.0:1788201331.425987:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.425998:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1788201331.426001:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201331.426008:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.426022:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201331.426025:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf841c0a80/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788201331.426032:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681287552:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788201331.426033:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.426041:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.426063:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201331.426092:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201331.426099:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.426106:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201331.426111:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.426119:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.426144:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.426152:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004b31272/0xf9b71aee44721283 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.426176:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201331.426179:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201331.426181:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201331.426183:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681287680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 240us (1113us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788201331.426196:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:3.0:1788201331.426426:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf841c5880/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788201331.426432:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681287680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201331.428480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.428606:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8485:1875064681287808:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201331.428631:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662366336 00000100:00100000:2.0:1788201331.428646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.428660:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662366336 00000100:00100000:1.0:1788201331.428768:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:1.0:1788201331.428796:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+13:2399:x1875064662366336:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788201331.428799:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662366464 00000100:00100000:3.0:1788201331.428814:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662366464 00010000:00010000:3.0:1788201331.428848:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 14 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.428900:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 102 00000100:00100000:3.0:1788201331.428910:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+14:2398:x1875064662366464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201331.428924:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201331.428932:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 14 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.428949:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 14 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.428978:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721030 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc313 expref: 14 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.429000:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201331.429005:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201331.429013:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.429026:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.429052:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201331.429124:0:8485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.429125:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+13:2398:x1875064662366464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 216us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201331.429156:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 102 00010000:00010000:1.0:1788201331.429240:0:8485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.429252:0:8485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.429264:0:8485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.429286:0:8485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.429320:0:8485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201331.429620:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201331.429630:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.429641:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201331.429646:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.429657:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.429674:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.429683:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee4472127c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.429716:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201331.429718:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201331.429720:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201331.432065:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0c1d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1875064681287424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6917us (7168us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788201331.432077:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1788201331.432444:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf841c2a00/2, rc 0, transno 4294967324 00000100:00100000:3.0:1788201331.432452:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681287424:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788201331.433464:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788201331.433480:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:1.0:1788201331.433843:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662366336:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 5044us (5367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.433855:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:2.0:1788201331.437634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201331.437723:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662366720 00000100:00100000:3.0:1788201331.437787:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662366720 00000100:00100000:1.0:1788201331.437922:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 245 00000100:00100000:1.0:1788201331.437943:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+21:12482:x1875064662366720:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201331.438018:0:8476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201331.438052:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee44721267 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3ad expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.438092:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:1.0:1788201331.438099:0:8476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201331.438138:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.438153:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.438163:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201331.439419:0:8476:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001eae9e78 reply state 0000000097956ee4 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.439451:0:8476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.439460:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:1.0:1788201331.439463:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201331.439466:0:8476:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201331.439870:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+22:12482:x1875064662366720:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 1931us (2245us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788201331.439881:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 245 00000100:00100000:3.0:1788201331.447871:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.448802:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662366848 00000100:00100000:0.0:1788201331.448814:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662366848 00000100:00100000:0.0:1788201331.448881:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:0.0:1788201331.448893:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2399:x1875064662366848:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788201331.449048:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788201331.449052:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788201330 -> 1788201330 00002000:00010000:0.0:1788201331.449054:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788201329 00002000:00010000:0.0:1788201331.449056:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788201330 -> 1788201330 00002000:00010000:0.0:1788201331.449058:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788201331.449125:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662366848:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 234us (1261us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788201331.449133:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:2.0:1788201331.455098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.455974:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662367104 00000100:00100000:1.0:1788201331.455984:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662367104 00000100:00100000:1.0:1788201331.456050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 246 00000100:00100000:1.0:1788201331.456059:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+22:12482:x1875064662367104:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788201331.456140:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.456165:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 22 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.456174:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.456211:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 22 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.456223:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 22 pid: 8476 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.456237:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681287936:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201331.456328:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201331.460376:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681287936:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201331.460408:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.460644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.461505:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662367232 00000100:00100000:2.0:1788201331.461514:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662367232 00010000:00010000:2.0:1788201331.461556:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 23 pid: 8476 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.461600:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 103 00000100:00100000:2.0:1788201331.461611:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+23:2398:x1875064662367232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201331.461624:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201331.461632:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 23 pid: 8476 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.461645:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 23 pid: 8476 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.461668:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee4472124b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc39f expref: 23 pid: 8476 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.461686:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:2.0:1788201331.461691:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.461701:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.461709:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.461790:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201331.461847:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+22:2398:x1875064662367232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 237us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.461868:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 103 00010000:00010000:1.0:1788201331.462258:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.462268:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.462310:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.462316:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.462323:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.462353:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201331.462357:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.462365:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.462375:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:1.0:1788201331.462378:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788201331.462382:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.462388:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee44721291 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.462562:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+21:12482:x1875064662367104:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 Request processed in 6503us (7471us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788201331.462572:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 246 00000100:00100000:1.0:1788201331.467630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.467727:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662367360 00000100:00100000:2.0:1788201331.467787:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662367360 00000100:00100000:2.0:1788201331.467842:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:2.0:1788201331.467853:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662367360:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788201331.467904:0:8485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.467923:0:8485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.467931:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201331.467935:0:8485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201331.467940:0:8485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.467975:0:8485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.467990:0:8485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 8 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.468006:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8485:1875064681288064:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201331.468093:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201331.470682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.470849:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8485:1875064681288064:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201331.470876:0:8485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.476654:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662367488 00000100:00100000:3.0:1788201331.476670:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662367488 00010000:00010000:2.0:1788201331.476827:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 9 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.476875:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 104 00000100:00100000:2.0:1788201331.476885:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+9:2399:x1875064662367488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201331.476901:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201331.476924:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 9 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.476937:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 9 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.476964:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee44721275 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3bb expref: 9 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.476982:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201331.476987:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201331.476993:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.477003:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.477042:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201331.477111:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2399:x1875064662367488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 227us (6438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.477119:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 104 00010000:00010000:1.0:1788201331.477273:0:8485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.477283:0:8485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.477311:0:8485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.477318:0:8485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.477326:0:8485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.477332:0:8485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201331.477337:0:8485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.477346:0:8485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.477358:0:8485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.477366:0:8485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d88124d/0xf9b71aee44721298 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.477413:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662367360:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 9562us (9792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.477421:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:0.0:1788201331.483220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.483327:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662367744 00000100:00100000:2.0:1788201331.483336:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662367744 00000100:00100000:2.0:1788201331.483396:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 247 00000100:00100000:2.0:1788201331.483405:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+21:12482:x1875064662367744:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788201331.483583:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.483602:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.483611:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.483643:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.483656:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 21 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.483671:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681288192:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201331.483886:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201331.487087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201331.487158:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662367872 00000100:00100000:3.0:1788201331.487174:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662367872 00000100:00100000:2.0:1788201331.487177:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681288192:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201331.487211:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.487235:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 22 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.487284:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 105 00000100:00100000:3.0:1788201331.487298:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+22:2398:x1875064662367872:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201331.487318:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201331.487326:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 22 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.487341:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 22 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.487369:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee4472118e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc367 expref: 22 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.487391:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:3.0:1788201331.487398:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 21 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.487433:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.487443:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.487451:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.487492:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201331.487718:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.487727:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.488002:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.488017:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 22 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.488026:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.488063:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 22 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.488078:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 22 pid: 10723 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.488094:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681288320:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201331.488208:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+22:2398:x1875064662367872:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 912us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201331.488219:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 105 00000100:00100000:2.0:1788201331.488356:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201331.494037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.494242:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681288320:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201331.494280:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.494683:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662368000 00000100:00100000:1.0:1788201331.494697:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662368000 00010000:00010000:1.0:1788201331.494791:0:13184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 22 pid: 10723 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.494839:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 106 00000100:00100000:1.0:1788201331.494849:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+22:2398:x1875064662368000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201331.494867:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201331.494875:0:13184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 22 pid: 10723 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.494890:0:13184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 22 pid: 10723 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.494912:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee44721259 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3a6 expref: 22 pid: 10723 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.494929:0:13184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:1.0:1788201331.494934:0:13184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.494943:0:13184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.494951:0:13184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.494980:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201331.495056:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+21:2398:x1875064662368000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 208us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.495063:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 106 00010000:00010000:0.0:1788201331.495395:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.495407:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201331.496442:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788201331.496725:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1788201331.496795:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1788201331.496904:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875064681288448:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201331.496984:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201331.497070:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08356be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201331.497521:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681288448 00000100:00100000:1.0:1788201331.497535:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681288448 00000100:00100000:1.0:1788201331.497671:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788201331.497683:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1875064681288448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201331.497870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1875064681288448:12345-0@lo:1000:mdt00_002.0 Request processed in 189us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.497882:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788201331.497921:0:6517:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788201331.497930:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967323 00000004:00080000:0.0:1788201331.497978:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf841c0a80, transno 4294967323 00000100:00100000:0.0:1788201331.498051:0:6517:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9cdf841c2a00 x1875064681287424/t4294967324(4294967324) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201347 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201331.498067:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875064681288448:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788201331.498223:0:6517:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788201331.498288:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875064681288576:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201331.498351:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201331.499847:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201331.499922:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681288576 00000100:00100000:2.0:1788201331.499933:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681288576 00000100:00100000:2.0:1788201331.499984:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788201331.499994:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6517:x1875064681288576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201331.500402:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875064681288576:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788201331.500461:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500493:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500502:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500570:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.500576:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500625:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500645:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:0.0:1788201331.500648:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201331.500653:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500659:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1200/0xf9b71aee447212a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500690:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500696:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500701:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500706:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367dc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.500715:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500721:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500730:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201331.500732:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201331.500784:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 24 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500799:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 24 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500810:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 24 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.500857:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 24 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201331.500876:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681288704:192.168.203.2@tcp:105: 00000100:00100000:0.0:1788201331.501807:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201331.503540:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6517:x1875064681288576:12345-0@lo:1000:mdt00_002.0 Request processed in 1670us (3311us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788201331.503556:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788201331.505087:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875064681288704:192.168.203.2@tcp:105: 00010000:00010000:0.0:1788201331.505116:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505126:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee447211e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505175:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505188:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505199:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505210:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505216:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505223:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505229:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367da00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.505233:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505239:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505262:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201331.505265:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.505269:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505275:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367da00/0xf9b71aee447212ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505290:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505296:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505303:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505308:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201331.505311:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505316:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505324:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201331.505326:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201331.505328:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.505333:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0e00/0xf9b71aee4472129f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201331.505481:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+24:12482:x1875064662367744:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 22076us (22267us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788201331.505491:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 247 00000020:00080000:0.0:1788201331.505496:0:6517:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788201331.505791:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201331.505803:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201331.506295:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788201331.506306:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201331.514245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.514322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.514447:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662368256 00000100:00100000:2.0:1788201331.514461:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662368256 00000100:00100000:2.0:1788201331.514515:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662368384 00000100:00100000:2.0:1788201331.514519:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662368384 00000100:00100000:2.0:1788201331.514536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:2.0:1788201331.514545:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+25:12482:x1875064662368256:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788201331.514877:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788201331.514916:0:6518:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788201331.514954:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.514970:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.514981:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.514990:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.514996:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.515002:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.515023:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201331.515119:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+27:12482:x1875064662368256:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 573us (888us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788201331.515127:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000020:00080000:2.0:1788201331.515132:0:6518:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788201331.515148:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:2.0:1788201331.515155:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+26:12481:x1875064662368384:12345-192.168.203.2@tcp:49:lfs.0 00000100:00100000:2.0:1788201331.515220:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+26:12481:x1875064662368384:12345-192.168.203.2@tcp:49:lfs.0 Request processed in 64us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.515227:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00010000:00010000:1.0:1788201331.516942:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201331.516959:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.516972:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201331.516977:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.516987:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.517020:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:1.0:1788201331.517025:0:7466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201331.517030:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.517037:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0800/0xf9b71aee447212b4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.517081:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201331.517084:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201331.517086:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201331.517698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201331.517839:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662368640 00000100:00100000:3.0:1788201331.517853:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662368640 00000100:00100000:3.0:1788201331.517921:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 248 00000100:00100000:3.0:1788201331.517933:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+26:12481:x1875064662368640:12345-192.168.203.2@tcp:58:lfs.0 00000040:00080000:3.0:1788201331.518103:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788201331.518180:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+26:12481:x1875064662368640:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 249us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201331.518187:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 248 00000100:00100000:0.0:1788201331.562979:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201331.566199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662368768 00000100:00100000:1.0:1788201331.566220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662368768 00000100:00100000:1.0:1788201331.566592:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 249 00000100:00100000:1.0:1788201331.566607:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+26:12484:x1875064662368768:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201331.566643:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201331.566671:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447212bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567126:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567145:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567157:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567174:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567181:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567187:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567854:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567872:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567883:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567930:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.567948:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 27 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.567966:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681288832:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201331.568576:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823c8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201331.572662:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875064681288832:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201331.572721:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.573109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201331.573186:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662369024 00000100:00100000:2.0:1788201331.573196:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662369024 00000100:00100000:2.0:1788201331.573259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:2.0:1788201331.573272:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+28:6168:x1875064662369024:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788201331.573576:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+29:6168:x1875064662369024:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 306us (468us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788201331.573585:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:3.0:1788201331.575937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201331.576396:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662369152 00000100:00100000:0.0:1788201331.576408:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662369152 00010000:00010000:0.0:1788201331.576461:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 29 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201331.576684:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:0.0:1788201331.576697:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+29:2401:x1875064662369152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201331.576715:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201331.576724:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 29 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.576796:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 29 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.576825:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447211db lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc383 expref: 29 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.576845:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201331.576853:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.576864:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.576874:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.576929:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201331.577007:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+28:2401:x1875064662369152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 312us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201331.577015:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 107 00010000:00010000:1.0:1788201331.577094:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577103:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201331.577166:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788201331.577172:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201331.577195:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577218:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577230:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577237:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577244:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577250:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201331.577254:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577263:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577273:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:1.0:1788201331.577276:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201331.577280:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577287:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee447212c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577301:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577309:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577323:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577328:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201331.577332:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577339:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577348:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ce0866cc400) 00010000:00010000:1.0:1788201331.577351:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201331.577354:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577360:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447212c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577403:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee447212bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3c2 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577419:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3c2 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.577426:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:1.0:1788201331.577428:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201331.577431:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254e00, rc 0) 00000100:00100000:1.0:1788201331.577481:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+27:12484:x1875064662368768:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 10878us (14517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.577497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 249 00010000:00010000:1.0:1788201331.894062:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201332.480979:0:14807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201332.480991:0:14807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201332.481152:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788201332.481160:0:14807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788201332.541126:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201332.541135:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201332.541163:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788201332.541171:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201332.541315:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681288960:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788201332.541434:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823c8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201332.548632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201332.549309:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662369280 00000100:00100000:0.0:1788201332.549327:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662369280 00000100:00100000:0.0:1788201332.549416:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 250 00000100:00100000:0.0:1788201332.549430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+28:12496:x1875064662369280:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788201332.549481:0:6517:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788201332.549647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+28:12496:x1875064662369280:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 219us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201332.549656:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 250 00000100:00100000:0.0:1788201332.549789:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875064681288960:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201332.557887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201332.558116:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662369536 00000100:00100000:0.0:1788201332.558127:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662369536 00000100:00100000:0.0:1788201332.558187:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 251 00000100:00100000:0.0:1788201332.558196:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+27:12496:x1875064662369536:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201332.558221:0:10723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201332.558243:0:10723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3c9 expref: -99 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.558385:0:10723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447212de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.558471:0:10723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447212de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.558498:0:10723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447212de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201332.558510:0:10723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788201332.559173:0:10723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3c9 expref: 30 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.559195:0:10723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447212de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3c9 expref: 29 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.559205:0:10723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201332.559209:0:10723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201332.559213:0:10723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367ce00, rc 0) 00000100:00100000:0.0:1788201332.559332:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+29:12496:x1875064662369536:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1135us (1606us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788201332.559341:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 251 00000100:00100000:1.0:1788201332.566965:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201332.567033:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662369664 00000100:00100000:3.0:1788201332.567063:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662369664 00000100:00100000:3.0:1788201332.567151:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:3.0:1788201332.567164:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+29:2401:x1875064662369664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201332.567185:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201332.567217:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367ce00/0xf9b71aee447212de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3c9 expref: 29 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.567237:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:3.0:1788201332.567243:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201332.567334:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+28:2401:x1875064662369664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 174us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201332.567341:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1788201332.573662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201332.574840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662369920 00000100:00100000:0.0:1788201332.574858:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662369920 00000100:00100000:0.0:1788201332.574955:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 252 00000100:00100000:0.0:1788201332.574968:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+28:12496:x1875064662369920:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788201332.575080:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575103:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575119:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575336:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575344:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575351:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575358:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201332.575363:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575370:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575384:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201332.575388:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201332.575394:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.575400:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447212ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.575568:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+29:12496:x1875064662369920:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 602us (1915us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788201332.575578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 252 00000040:00080000:2.0:1788201332.577429:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201332.577439:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201332.579056:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788201332.579071:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201332.581450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201332.581523:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662370176 00000100:00100000:3.0:1788201332.581533:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662370176 00000100:00100000:3.0:1788201332.581669:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:3.0:1788201332.581713:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+29:12496:x1875064662370176:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788201332.582048:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:12496:x1875064662370176:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 368us (607us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788201332.582056:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00010000:00010000:2.0:1788201332.918419:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201333.367010:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681289344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.367142:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681289856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367168:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.367191:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681290368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367212:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.367235:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201333.367241:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681289472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367262:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.367280:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681289984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.367335:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681290496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367357:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.367386:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681289344 00000100:00100000:1.0:1788201333.367392:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681289344 00000100:00100000:1.0:1788201333.367436:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788201333.367444:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681289344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367497:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681289344:12345-0@lo:400:kworker.0 Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201333.367504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788201333.367545:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681289856 00000100:00100000:1.0:1788201333.367549:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681289856 00000100:00100000:1.0:1788201333.367580:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681290368 00000100:00100000:1.0:1788201333.367583:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681290368 00000100:00100000:1.0:1788201333.367599:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681289472 00000100:00100000:1.0:1788201333.367602:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681289472 00000100:00100000:1.0:1788201333.367616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788201333.367621:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681289856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367651:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681289856:12345-0@lo:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201333.367657:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788201333.367670:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788201333.367676:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681290368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367700:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681290368:12345-0@lo:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201333.367706:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788201333.367717:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788201333.367721:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681289472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367797:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681289472:12345-0@lo:400:kworker.0 Request processed in 75us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201333.367803:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788201333.367841:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681289472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.367851:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681289344:0@lo:400:kworker.0 00010000:00080000:1.0:1788201333.367862:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8410fb80 x1875064681289856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201333.367871:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681289856:0@lo:400:kworker.0 00010000:00080000:1.0:1788201333.367879:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8410ed80 x1875064681290368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201333.367888:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681290368:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368168:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681289088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201333.368254:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681289600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201333.368297:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681290112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368317:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201333.368334:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681290624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201333.368371:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201333.368377:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681289216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201333.368427:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681289728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201333.368458:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681290240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201333.368496:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681289216 00000100:00100000:0.0:1788201333.368501:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681289216 00000100:00100000:0.0:1788201333.368523:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681289728 00000100:00100000:0.0:1788201333.368540:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681289728 00000100:00100000:0.0:1788201333.368556:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681290240 00000100:00100000:0.0:1788201333.368558:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681290240 00000100:00100000:0.0:1788201333.368570:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788201333.368576:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681289216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368620:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681289216:12345-0@lo:400:kworker.0 Request processed in 45us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.368626:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788201333.368639:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788201333.368645:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681289728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368683:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681289728:12345-0@lo:400:kworker.0 Request processed in 39us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.368690:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788201333.368701:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788201333.368707:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681290240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368728:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681290240:12345-0@lo:400:kworker.0 Request processed in 22us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.368732:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788201333.368788:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681289984 00000100:00100000:0.0:1788201333.368793:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681289984 00000100:00100000:0.0:1788201333.368812:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681290496 00000100:00100000:0.0:1788201333.368814:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681290496 00000100:00100000:0.0:1788201333.368826:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681290112 00000100:00100000:0.0:1788201333.368827:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681290112 00000100:00100000:0.0:1788201333.368836:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681290624 00000100:00100000:0.0:1788201333.368839:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681290624 00000100:00100000:0.0:1788201333.368849:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788201333.368853:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681289984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368887:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681289984:12345-0@lo:400:kworker.0 Request processed in 33us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.368894:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788201333.368905:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788201333.368911:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681290496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368937:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681290496:12345-0@lo:400:kworker.0 Request processed in 27us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.368943:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788201333.368952:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201333.368964:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681290112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.368994:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681290112:12345-0@lo:400:kworker.0 Request processed in 31us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.369000:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201333.369011:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788201333.369016:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681290624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.369041:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681290624:12345-0@lo:400:kworker.0 Request processed in 26us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.369047:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1788201333.369062:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201333.369067:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201333.369069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201333.369071:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201333.369086:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681289088 00000100:00100000:0.0:1788201333.369090:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681289088 00000100:00100000:0.0:1788201333.369115:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788201333.369121:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681289088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.369149:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681289088:12345-0@lo:400:kworker.0 Request processed in 29us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.369154:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788201333.369201:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681289216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.369211:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681289728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.369220:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681290240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.369228:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681289088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.369237:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681290112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.369256:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681290624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201333.369795:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681289600 00000100:00100000:3.0:1788201333.369801:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681289600 00000100:00100000:2.0:1788201333.369822:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681290752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201333.369836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788201333.369846:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b32a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681289600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201333.369865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201333.369899:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b32a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681289600:12345-0@lo:400:kworker.0 Request processed in 55us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201333.369906:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788201333.369925:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681290752 00000100:00100000:2.0:1788201333.369930:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681290752 00000100:00100000:2.0:1788201333.369964:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201333.369973:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681290752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201333.369998:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201333.370042:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681290752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201333.370057:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201333.370103:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681290752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201333.370348:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681289984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.370361:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681290496:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.376877:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681289600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.877960:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681290880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201333.878693:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201333.878785:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681290880 00000100:00100000:2.0:1788201333.878793:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681290880 00000100:00100000:2.0:1788201333.878950:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788201333.878961:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681290880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201333.878986:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201333.879046:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681290880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201333.879053:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201333.879659:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681290880:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201333.942034:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201333.957528:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201333.957577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201333.957627:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201333.957645:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662370304 00000100:00100000:3.0:1788201333.957656:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662370304 00000100:00100000:0.0:1788201333.957661:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201333.957690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201333.957717:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 389 00000100:00100000:0.0:1788201333.957723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201333.957731:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662370304:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201333.957792:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662370688 00000100:00100000:2.0:1788201333.957797:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662370688 00000100:00100000:0.0:1788201333.957802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201333.957833:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662370432 00000100:00100000:0.0:1788201333.957838:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662370432 00000100:00100000:2.0:1788201333.957850:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662370816 00000100:00100000:2.0:1788201333.957855:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662370816 00000100:00100000:0.0:1788201333.957882:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662370944 00000100:00100000:0.0:1788201333.957887:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662370944 00000100:00100000:2.0:1788201333.957892:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:2.0:1788201333.957902:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662370688:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201333.957909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662370560 00000100:00100000:0.0:1788201333.957912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662370560 00000100:00100000:0.0:1788201333.957927:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662371072 00000100:00100000:0.0:1788201333.957930:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662371072 00000100:00100000:0.0:1788201333.957947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 326 00000100:00100000:0.0:1788201333.957955:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:2399:x1875064662370432:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201333.957976:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2398:x1875064662370688:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201333.957984:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:0.0:1788201333.957993:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:2399:x1875064662370432:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 38us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.958001:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 326 00000100:00100000:2.0:1788201333.958006:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:2.0:1788201333.958016:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662370816:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201333.958022:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 327 00000100:00100000:0.0:1788201333.958032:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662370944:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201333.958051:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662370816:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201333.958058:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:0.0:1788201333.958065:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662370944:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 34us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.958086:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 327 00000100:00100000:0.0:1788201333.958104:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 328 00000100:00100000:0.0:1788201333.958112:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662370560:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201333.958143:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2398:x1875064662370560:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 32us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.958150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 328 00000100:00100000:0.0:1788201333.958163:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 329 00000100:00100000:0.0:1788201333.958170:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662371072:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201333.958196:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2398:x1875064662371072:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.958203:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 329 00000100:00080000:0.0:1788201333.958255:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201333.958260:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201333.958262:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201333.958264:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201333.962291:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2399:x1875064662370304:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 4555us (4764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201333.962303:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 389 00000040:00080000:2.0:1788201334.117262:0:14858:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201334.117278:0:14858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201334.117318:0:14858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788201334.117325:0:14858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201334.250340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201334.251586:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662371328 00000100:00100000:0.0:1788201334.251598:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662371328 00000100:00100000:0.0:1788201334.251653:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 253 00000100:00100000:0.0:1788201334.251663:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+30:12516:x1875064662371328:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201334.251682:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201334.251702:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee447212f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.251835:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447212fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.251861:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447212fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.251873:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447212fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201334.251885:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788201334.251986:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367cc00/0xf9b71aee447212f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3d0 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.252003:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447212fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3d0 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.252012:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201334.252015:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788201334.252018:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367c600, rc 0) 00000100:00100000:0.0:1788201334.252078:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+32:12516:x1875064662371328:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 417us (1744us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788201334.252086:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 253 00000100:00100000:1.0:1788201334.264070:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201334.264639:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662371456 00000100:00100000:0.0:1788201334.264650:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662371456 00000100:00100000:0.0:1788201334.264706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 254 00000100:00100000:0.0:1788201334.264717:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+32:12516:x1875064662371456:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:0.0:1788201334.264815:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264831:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264854:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264904:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264911:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264918:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264924:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367dc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201334.264929:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264936:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264947:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:0.0:1788201334.264950:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201334.264955:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201334.264961:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367dc00/0xf9b71aee44721308 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201334.265029:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+32:12516:x1875064662371456:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 314us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201334.265037:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 254 00000100:00100000:3.0:1788201334.343443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201334.343626:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662371584 00000100:00100000:2.0:1788201334.343635:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662371584 00000100:00100000:2.0:1788201334.343735:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:2.0:1788201334.343776:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662371584:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1788201334.343796:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201334.343818:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009687503d/0xf9b71aee4472130f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3d7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201334.343844:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a95c972, atime: 0x6a95c971, ctime: 0x6a95c972, blocks: 0x8 00010000:00010000:2.0:1788201334.343875:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788201334.343879:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201334.343889:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009687503d/0xf9b71aee4472130f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3d7 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201334.343907:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009687503d/0xf9b71aee4472130f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3d7 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201334.343918:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0e00, rc 0) 00000100:00100000:2.0:1788201334.343981:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2400:x1875064662371584:12345-192.168.203.2@tcp:101:cat.0 Request processed in 208us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201334.343987:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:2.0:1788201334.351147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201334.353277:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662371712 00000100:00100000:3.0:1788201334.353301:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662371712 00002000:00100000:3.0:1788201334.353650:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9cdf841c7b80 x1875064662371712/t0(0) o3->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:455/0 lens 488/0 e 0 to 0 dl 1788201345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201334.353662:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf841c7b80 with x1875064662371712 ext(0->4095) 00002000:00010000:3.0:1788201334.353668:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf841c7b80 00000100:00100000:3.0:1788201334.353802:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1788201334.353813:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662371712:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1788201334.354142:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+8:2398:x1875064662371712:12345-192.168.203.2@tcp:3:cat.0 Request processed in 331us (3003us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788201334.354151:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00002000:00100000:3.0:1788201334.354158:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9cdf841c7b80 x1875064662371712/t0(0) o3->da566c69-17bd-4938-bc1e-8b9ba2633293@192.168.203.2@tcp:455/0 lens 488/4536 e 0 to 0 dl 1788201345 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201334.354166:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cdf841c7b80 with x1875064662371712 ext(0->4095) 00002000:00010000:3.0:1788201334.354170:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cdf841c7b80 00010000:00010000:3.0:1788201334.969870:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201335.414126:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681291136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201335.414232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201335.414305:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681291008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201335.414347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201335.414373:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681291136 00000100:00100000:3.0:1788201335.414399:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681291136 00000100:00100000:3.0:1788201335.414454:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681291008 00000100:00100000:3.0:1788201335.414458:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681291008 00000100:00100000:3.0:1788201335.414479:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201335.414489:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681291136:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201335.414490:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788201335.414503:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681291008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201335.414530:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:0.0:1788201335.414530:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788201335.415456:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681291008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 949us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201335.415468:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788201335.415874:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681291136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1385us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201335.415884:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788201335.415958:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681291136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201335.416080:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681291008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201335.925996:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201335.926024:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681291264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201335.926096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201335.926302:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681291392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201335.926338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201335.929053:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681291264 00000100:00100000:0.0:1788201335.929066:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681291264 00000100:00100000:0.0:1788201335.929159:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681291392 00000100:00080000:2.0:1788201335.929163:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201335.929164:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681291392 00000100:00100000:0.0:1788201335.929188:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201335.929200:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681291264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201335.929234:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788201335.929319:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681291264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201335.929326:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201335.929345:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788201335.929351:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681291392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201335.929362:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788201335.929423:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681291264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201335.931285:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875064681291392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1927us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201335.931299:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788201335.931953:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681291392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201335.990017:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201336.451944:0:9511:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1788201337.014287:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201337.464323:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:0.0:1788201337.464344:0:8425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788201337.478957:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788201337.479008:0:6495:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce08356b9c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788201337.479015:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0912d0000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce08356be40 00000020:00080000:0.0:1788201337.479038:0:6495:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0912d0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ce085e69200 00000020:00080000:0.0:1788201337.479065:0:6495:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788201337.479130:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:2.0:1788201337.479200:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201337.479216:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788201337.479225:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788201337.479227:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201337.479240:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201337.479248:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201337.479257:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201337.479279:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ce0866cc600) 00010000:00010000:2.0:1788201337.479282:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201337.479288:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201337.479294:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee4472128a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201338.040983:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201338.485859:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681291520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201338.485975:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.486072:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681291520 00000100:00100000:2.0:1788201338.486080:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681291520 00000100:00100000:2.0:1788201338.486129:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788201338.486137:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681291520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201338.486177:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201338.486219:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681291520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.486226:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788201338.486249:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201338.486277:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788201338.486282:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788201338.486298:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf841c5880, transno 4294967311 00000100:00100000:2.0:1788201338.486316:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681291520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201338.486583:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681291648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.486640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.486665:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681292160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.486706:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.486766:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681292672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.486789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.486821:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788201338.486828:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681292032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.486875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.486894:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681292544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.486930:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.486952:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681293056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.486961:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681291904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.486974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201338.487003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.487007:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681291776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.487042:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681292416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.487050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201338.487079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.487084:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681292288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.487105:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681292928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.487113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.487136:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681292800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.487140:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.487169:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681291648 00000100:00100000:2.0:1788201338.487174:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681291648 00000100:00100000:2.0:1788201338.487202:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788201338.487208:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681291648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.487254:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681292160 00000100:00100000:2.0:1788201338.487255:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681291648:12345-0@lo:400:kworker.0 Request processed in 46us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487263:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788201338.487266:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681292160 00000100:00100000:2.0:1788201338.487300:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681291904 00000100:00100000:2.0:1788201338.487305:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681291904 00000100:00100000:3.0:1788201338.487306:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788201338.487316:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681292160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.487328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788201338.487337:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681291904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.487358:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681292160:12345-0@lo:400:kworker.0 Request processed in 44us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201338.487366:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788201338.487385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681291904:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788201338.487413:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681292672 00000100:00100000:2.0:1788201338.487416:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681292672 00000100:00100000:2.0:1788201338.487444:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681292544 00000100:00100000:2.0:1788201338.487447:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681292544 00000100:00100000:2.0:1788201338.487460:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681293056 00000100:00100000:2.0:1788201338.487463:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681293056 00000100:00100000:2.0:1788201338.487477:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201338.487484:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681292672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.487516:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681292672:12345-0@lo:400:kworker.0 Request processed in 33us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487531:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201338.487546:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201338.487552:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681292544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.487581:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681292544:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487587:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201338.487598:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788201338.487604:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681293056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.487632:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681293056:12345-0@lo:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487638:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201338.487662:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681292032 00000100:00100000:2.0:1788201338.487663:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681291776 00000100:00100000:2.0:1788201338.487669:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681291776 00000100:00100000:0.0:1788201338.487669:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681292032 00000100:00100000:0.0:1788201338.487701:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681292416 00000100:00100000:2.0:1788201338.487704:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681292288 00000100:00100000:0.0:1788201338.487706:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681292416 00000100:00100000:2.0:1788201338.487710:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681292288 00000100:00100000:0.0:1788201338.487766:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681292928 00000100:00100000:0.0:1788201338.487770:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681292928 00000100:00100000:2.0:1788201338.487774:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788201338.487783:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681292032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201338.487798:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788201338.487808:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681291776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.487819:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681292032:12345-0@lo:400:kworker.0 Request processed in 37us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487826:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788201338.487844:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788201338.487855:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681291776:12345-0@lo:400:kworker.0 Request processed in 47us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487856:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681292416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201338.487869:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788201338.487889:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788201338.487896:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681292416:12345-0@lo:400:kworker.0 Request processed in 45us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201338.487901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681292288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.487908:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788201338.487935:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788201338.487942:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681292288:12345-0@lo:400:kworker.0 Request processed in 45us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487945:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681292928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201338.487954:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788201338.487990:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875064681292928:12345-0@lo:400:kworker.0 Request processed in 47us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.487997:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788201338.488038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201338.488076:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681291776:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488088:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681292288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488118:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681292032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488128:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681292544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488137:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681293056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681291648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488155:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681292160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488178:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1788201338.488182:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf841c2a00, transno 4294967324 00000004:00080000:2.0:1788201338.488194:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1788201338.488208:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681292672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488243:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681291904:0@lo:400:kworker.0 00010000:00080000:2.0:1788201338.488255:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf521f80 x1875064681292416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201338.488265:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681292416:0@lo:400:kworker.0 00010000:00080000:2.0:1788201338.488277:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf522680 x1875064681292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201338.488294:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681292928:0@lo:400:kworker.0 00000100:00080000:2.0:1788201338.488318:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201338.488323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201338.488327:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201338.488329:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201338.488425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681292800 00000100:00100000:2.0:1788201338.488430:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681292800 00000100:00100000:2.0:1788201338.488465:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788201338.488474:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681292800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201338.488515:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681292800:12345-0@lo:400:kworker.0 Request processed in 43us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.488521:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:2.0:1788201338.488562:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201338.488584:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681292800:0@lo:400:kworker.0 00000040:00080000:0.0:1788201338.678648:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788201338.747392:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201338.747400:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201338.747418:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788201338.747424:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201338.967895:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201338.968000:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662371840 00000100:00100000:2.0:1788201338.968009:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662371840 00000100:00100000:2.0:1788201338.968092:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 255 00000100:00100000:2.0:1788201338.968103:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+18:12162:x1875064662371840:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788201338.968218:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+18:12162:x1875064662371840:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 116us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201338.968225:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 255 00000100:00080000:0.0:1788201338.968678:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201338.974200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201338.974484:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662371968 00000100:00100000:0.0:1788201338.974494:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662371968 00000100:00100000:0.0:1788201338.974570:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 256 00000100:00100000:0.0:1788201338.974581:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:12162:x1875064662371968:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788201338.974778:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:12162:x1875064662371968:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 198us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201338.974787:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 256 00000100:00080000:2.0:1788201338.974862:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201338.985065:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201338.985161:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662372224 00000100:00100000:2.0:1788201338.985171:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662372224 00000100:00100000:2.0:1788201338.985227:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1788201338.985261:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+18:12162:x1875064662372224:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788201338.986025:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+19:12162:x1875064662372224:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 762us (965us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788201338.986036:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:0.0:1788201338.998087:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201338.998112:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681293184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201338.998185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201338.998326:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681293184 00000100:00100000:3.0:1788201338.998333:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681293184 00000100:00100000:3.0:1788201338.998386:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788201338.998395:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681293184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201338.998417:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201338.998483:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681293184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201338.998490:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788201338.998809:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681293184:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201339.063050:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201339.077342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201339.087033:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662372352 00000100:00100000:3.0:1788201339.087050:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662372352 00000100:00100000:3.0:1788201339.087167:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 391 00000100:00100000:3.0:1788201339.087179:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662372352:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201339.087268:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2400:x1875064662372352:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 91us (9935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201339.087276:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 391 00000100:00100000:0.0:1788201339.088131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201339.088251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201339.088288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201339.088310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201339.088337:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662372736 00000100:00100000:0.0:1788201339.088342:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662372736 00000100:00100000:2.0:1788201339.088516:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662372480 00000100:00100000:2.0:1788201339.088521:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662372480 00000100:00100000:3.0:1788201339.088631:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662372608 00000100:00100000:3.0:1788201339.088635:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662372608 00000100:00100000:0.0:1788201339.088697:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662372864 00000100:00100000:0.0:1788201339.088700:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662372864 00000100:00100000:1.0:1788201339.088789:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 336 00000100:00100000:1.0:1788201339.088801:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662372736:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201339.088864:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662372736:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 66us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201339.088870:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 336 00000100:00100000:2.0:1788201339.092294:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00100000:2.0:1788201339.092316:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662372480:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201339.092787:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:3.0:1788201339.092801:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662372608:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201339.092857:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662372608:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 61us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201339.092878:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:2.0:1788201339.093567:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2400:x1875064662372480:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 1255us (5434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201339.093576:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00100000:0.0:1788201339.094539:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 337 00000100:00100000:0.0:1788201339.094553:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662372864:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201339.094615:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2400:x1875064662372864:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 61us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201339.094622:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 337 00000100:00080000:1.0:1788201339.094729:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201339.094735:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201339.094750:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201339.094753:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201339.192874:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201339.193017:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662372992 00000100:00100000:3.0:1788201339.193032:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662372992 00000100:00100000:3.0:1788201339.193113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 257 00000100:00100000:3.0:1788201339.193125:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+5:12973:x1875064662372992:12345-192.168.203.2@tcp:101:lsof.0 00010000:00010000:3.0:1788201339.193155:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201339.193287:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201339.193508:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472131d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201339.193522:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472131d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201339.193534:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472131d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201339.193582:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201339.193586:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201339.193775:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472131d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201339.193805:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44721316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3de expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201339.193849:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472131d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3de expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201339.193859:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:2.0:1788201339.193862:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201339.193866:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0200, rc 0) 00000100:00100000:2.0:1788201339.193977:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+6:12973:x1875064662372992:12345-192.168.203.2@tcp:101:lsof.0 Request processed in 854us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201339.193985:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 257 00010000:00010000:1.0:1788201340.087140:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201340.535337:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681293312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201340.535413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201340.535690:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681293312 00000100:00100000:2.0:1788201340.535700:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681293312 00000100:00100000:2.0:1788201340.535786:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788201340.535797:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681293312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201340.535833:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201340.535878:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681293312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201340.535896:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788201340.536272:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681293312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201340.536632:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201340.536644:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681293440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201340.536678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201340.536817:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681293440 00000100:00100000:2.0:1788201340.536823:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681293440 00000100:00100000:2.0:1788201340.536861:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788201340.536868:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681293440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201340.537050:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788201340.537211:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681293440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 342us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201340.537218:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788201340.542990:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681293440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201341.047391:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681293568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201341.047456:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201341.047590:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681293568 00000100:00100000:0.0:1788201341.047597:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681293568 00000100:00100000:0.0:1788201341.047655:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201341.047675:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681293568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201341.047713:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788201341.047776:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681293568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201341.047783:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201341.047839:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681293568:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201341.048095:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201341.048267:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681293696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201341.048299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201341.048368:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681293696 00000100:00100000:1.0:1788201341.048372:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681293696 00000100:00100000:1.0:1788201341.048418:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201341.048425:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681293696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201341.048437:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788201341.048465:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681293696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201341.048471:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788201341.048519:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201341.048581:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681293696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201341.110075:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201342.133857:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201342.507548:0:15056:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:35:40 (1788201340) 00010000:00010000:1.0:1788201343.159993:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201343.606060:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681293952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201343.606168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201343.606236:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681294464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201343.606270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201343.606297:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681294976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201343.606321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201343.606334:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681295488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201343.606353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606447:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681293824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201343.606520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606557:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681294336:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606606:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681294848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606644:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681295360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606705:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681294208:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606729:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606766:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681294720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606798:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606815:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681295232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606864:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788201343.606871:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681294080:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606892:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606910:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681294592:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606942:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681295104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.606959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201343.606982:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681294976 00000100:00100000:3.0:1788201343.606988:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681294976 00000100:00100000:3.0:1788201343.607027:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681295488 00000100:00100000:3.0:1788201343.607030:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681295488 00000100:00100000:3.0:1788201343.607041:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681294848 00000100:00100000:3.0:1788201343.607043:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681294848 00000100:00100000:3.0:1788201343.607055:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681295360 00000100:00100000:3.0:1788201343.607056:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681295360 00000100:00100000:3.0:1788201343.607069:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788201343.607076:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681294976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201343.609029:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681293952 00000100:00100000:2.0:1788201343.609040:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681293952 00000100:00100000:2.0:1788201343.609086:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788201343.609094:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681293952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201343.609163:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681293952:12345-0@lo:400:kworker.0 Request processed in 70us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201343.609170:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788201343.609204:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681294336 00000100:00100000:2.0:1788201343.609208:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681294336 00000100:00100000:2.0:1788201343.609227:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681294720 00000100:00100000:2.0:1788201343.609230:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681294720 00000100:00100000:2.0:1788201343.609245:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681295232 00000100:00100000:2.0:1788201343.609247:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681295232 00000100:00100000:2.0:1788201343.609259:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681294080 00000100:00100000:2.0:1788201343.609261:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681294080 00000100:00100000:2.0:1788201343.609272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681294592 00000100:00100000:2.0:1788201343.609274:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681294592 00000100:00100000:2.0:1788201343.609285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681295104 00000100:00100000:2.0:1788201343.609287:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681295104 00000100:00100000:2.0:1788201343.609299:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788201343.609305:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681294336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201343.609343:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681294336:12345-0@lo:400:kworker.0 Request processed in 38us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201343.609348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788201343.609359:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788201343.609374:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681294720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201343.609411:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681294720:12345-0@lo:400:kworker.0 Request processed in 38us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201343.609417:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788201343.609430:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788201343.609436:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681295232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201343.609464:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681295232:12345-0@lo:400:kworker.0 Request processed in 28us (2630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201343.609470:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788201343.609482:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788201343.609488:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681294080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201343.609512:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681294080:12345-0@lo:400:kworker.0 Request processed in 25us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201343.609518:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788201343.609546:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788201343.609552:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681294592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201343.609580:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681294592:12345-0@lo:400:kworker.0 Request processed in 29us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201343.609586:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788201343.611239:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681294464 00000100:00100000:0.0:1788201343.611251:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681294464 00000100:00100000:0.0:1788201343.611292:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681294208 00000100:00100000:0.0:1788201343.611295:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681294208 00000100:00100000:0.0:1788201343.611311:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788201343.611319:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681294464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201343.611389:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681294464:12345-0@lo:400:kworker.0 Request processed in 71us (5119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201343.611395:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788201343.611410:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788201343.611416:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681294208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201343.611444:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681294208:12345-0@lo:400:kworker.0 Request processed in 28us (4714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201343.611450:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788201343.611537:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788201343.611545:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681295104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201343.611577:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681295104:12345-0@lo:400:kworker.0 Request processed in 34us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201343.611592:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788201343.612076:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201343.612093:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681295488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201343.612129:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681295488:12345-0@lo:400:kworker.0 Request processed in 39us (5776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201343.612135:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201343.612148:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201343.612155:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681294848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201343.612182:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681294848:12345-0@lo:400:kworker.0 Request processed in 28us (5553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201343.612186:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201343.612197:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201343.612202:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681295360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201343.612227:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681295360:12345-0@lo:400:kworker.0 Request processed in 25us (5565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201343.612233:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201343.612260:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681293824 00000100:00100000:0.0:1788201343.612266:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681293824 00000100:00100000:0.0:1788201343.612301:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201343.612308:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681293824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201343.612329:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201343.612362:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681293824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (5842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201343.612368:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788201343.612568:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201343.612578:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201343.612582:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201343.612584:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201343.613144:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681294976:12345-0@lo:400:kworker.0 Request processed in 6065us (6819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201343.613155:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788201343.613243:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681294080:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.613257:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681294592:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.613268:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681295104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.613291:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681294208:0@lo:400:kworker.0 00010000:00080000:3.0:1788201343.613305:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8410fb80 x1875064681294720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201343.613315:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681294720:0@lo:400:kworker.0 00010000:00080000:3.0:1788201343.613325:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8410d500 x1875064681295232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201343.613332:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681295232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.613379:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681293824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201343.613391:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681294336:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.613401:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681294848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201343.613412:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681295360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201343.616577:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681293952:0@lo:400:kworker.0 00000001:00080000:3.0:1788201343.618269:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788201343.618287:0:6495:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788201343.618616:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788201343.618638:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788201343.618711:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681294464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201343.618732:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681294976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201343.618770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681295488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201344.119044:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681295616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201344.119153:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201344.119526:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681295616 00000100:00100000:3.0:1788201344.119538:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681295616 00000100:00100000:3.0:1788201344.119605:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201344.119616:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681295616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201344.119648:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201344.120175:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681295616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201344.122443:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681295616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201344.122461:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00010000:0.0:1788201344.182419:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201344.196101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201344.196147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201344.196202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201344.198776:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201344.198802:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201344.198822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201344.198843:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201344.198870:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662373120 00000100:00100000:3.0:1788201344.198878:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662373120 00000100:00100000:3.0:1788201344.198931:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 393 00000100:00100000:3.0:1788201344.198942:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662373120:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201344.200055:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662373120:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 1048us (3897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201344.200068:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 393 00000100:00100000:0.0:1788201344.200188:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662373632 00000100:00100000:0.0:1788201344.200195:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662373632 00000100:00100000:0.0:1788201344.200254:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662373504 00000100:00100000:0.0:1788201344.200257:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662373504 00000100:00100000:0.0:1788201344.200298:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:0.0:1788201344.200307:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662373632:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201344.200373:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662373376 00000100:00100000:3.0:1788201344.200378:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662373376 00000100:00100000:3.0:1788201344.200413:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662373888 00000100:00100000:3.0:1788201344.200416:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662373888 00000100:00100000:3.0:1788201344.200434:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662373248 00000100:00100000:3.0:1788201344.200437:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662373248 00000100:00100000:3.0:1788201344.200450:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662373760 00000100:00100000:3.0:1788201344.200453:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662373760 00000100:00100000:3.0:1788201344.200466:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 344 00000100:00100000:3.0:1788201344.200474:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662373376:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201344.202933:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662373632:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 2616us (6719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201344.202948:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:3.0:1788201344.203073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2401:x1875064662373376:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 2597us (6924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201344.203086:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 344 00000100:00100000:0.0:1788201344.203331:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:0.0:1788201344.203346:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2401:x1875064662373504:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201344.203393:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2401:x1875064662373504:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 53us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201344.203399:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:0.0:1788201344.203429:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 345 00000100:00100000:0.0:1788201344.203436:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662373888:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201344.203459:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+5:2401:x1875064662373888:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (4693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201344.203465:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 345 00000100:00100000:0.0:1788201344.203478:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 346 00000100:00100000:0.0:1788201344.203485:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+18:2401:x1875064662373248:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201344.203532:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+18:2401:x1875064662373248:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 47us (4729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201344.203538:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 346 00000100:00100000:0.0:1788201344.203554:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 347 00000100:00100000:0.0:1788201344.203560:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+6:2401:x1875064662373760:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201344.203583:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1faf6d77-706d-41b4-9836-f216205de0f1+6:2401:x1875064662373760:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (4739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201344.203590:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 347 00000100:00080000:0.0:1788201344.203619:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201344.203623:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201344.203626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201344.203629:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201345.206028:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201345.655165:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201345.655199:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681295744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201345.655293:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201345.656205:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681295744 00000100:00100000:2.0:1788201345.656219:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681295744 00000100:00100000:2.0:1788201345.656299:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788201345.656311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681295744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201345.656519:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788201345.656642:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681295744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 332us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201345.656649:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788201345.656862:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681295744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201345.664508:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201345.664541:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681295872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201345.664632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201345.664945:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681295872 00000100:00100000:3.0:1788201345.664956:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681295872 00000100:00100000:3.0:1788201345.665027:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788201345.665069:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681295872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201345.665118:0:9551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788201345.665186:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681295872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201345.665194:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788201345.665364:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681295872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201346.135312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201346.135450:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662374144 00000100:00100000:2.0:1788201346.135463:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662374144 00000100:00100000:2.0:1788201346.135564:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:2.0:1788201346.135579:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+18:13196:x1875064662374144:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:2.0:1788201346.135991:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+19:13196:x1875064662374144:12345-192.168.203.2@tcp:35:umount.0 Request processed in 415us (704us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788201346.136000:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00080000:0.0:1788201346.136274:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201346.140641:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201346.140778:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662374400 00000100:00100000:2.0:1788201346.140792:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662374400 00000100:00100000:2.0:1788201346.140869:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:2.0:1788201346.140881:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+19:13196:x1875064662374400:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:2.0:1788201346.141305:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+20:13196:x1875064662374400:12345-192.168.203.2@tcp:35:umount.0 Request processed in 414us (667us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788201346.141314:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:1.0:1788201346.152007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201346.155489:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662374656 00000100:00100000:2.0:1788201346.155507:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662374656 00000100:00100000:2.0:1788201346.155604:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:2.0:1788201346.155618:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aaf42c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+20:13196:x1875064662374656:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:2.0:1788201346.155971:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aaf42c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da566c69-17bd-4938-bc1e-8b9ba2633293+21:13196:x1875064662374656:12345-192.168.203.2@tcp:35:umount.0 Request processed in 354us (3977us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788201346.155979:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:1.0:1788201346.159416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201346.159618:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662374912 00000100:00100000:3.0:1788201346.159630:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662374912 00000100:00100000:3.0:1788201346.159709:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1788201346.159721:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+21:13196:x1875064662374912:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:3.0:1788201346.162367:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da566c69-17bd-4938-bc1e-8b9ba2633293+22:13196:x1875064662374912:12345-192.168.203.2@tcp:35:umount.0 Request processed in 2631us (2956us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788201346.162385:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:2.0:1788201346.166179:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681296000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201346.166305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201346.166497:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681296000 00000100:00100000:3.0:1788201346.166508:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681296000 00000100:00100000:3.0:1788201346.166583:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788201346.166597:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681296000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201346.166634:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1788201346.167530:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201346.167602:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201346.167622:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681296128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201346.167681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201346.167766:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788201346.167777:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788201346.167903:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681296128 00000100:00100000:0.0:1788201346.167909:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681296128 00000100:00100000:3.0:1788201346.169065:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681296000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2463us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201346.169082:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681296000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201346.169083:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788201346.169275:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788201346.169293:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681296128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201346.169323:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788201346.169409:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681296128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201346.169416:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788201346.169455:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201346.174256:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681296128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201346.185147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201346.185206:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201346.185354:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662375168 00000100:00100000:0.0:1788201346.185366:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662375168 00000100:00100000:0.0:1788201346.185455:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662375040 00000100:00100000:0.0:1788201346.185458:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662375040 00000100:00100000:0.0:1788201346.185487:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1788201346.185498:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+14:2401:x1875064662375168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201346.185518:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201346.185545:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1000/0xf9b71aee44720237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbef2 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201346.185566:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201346.185632:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+13:2401:x1875064662375168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 136us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201346.185641:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1788201346.185659:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1788201346.185666:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+12:2401:x1875064662375040:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201346.185686:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201346.185695:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254400/0xf9b71aee44720276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf31 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201346.185704:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201346.185722:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:2401:x1875064662375040:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 57us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201346.185729:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:1.0:1788201346.200223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201346.200276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201346.200438:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662375296 00000100:00100000:0.0:1788201346.200452:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662375296 00000100:00100000:0.0:1788201346.200547:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:0.0:1788201346.200577:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2397:x1875064662375296:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:0.0:1788201346.200632:0:8485:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720612 00000100:00080000:0.0:1788201346.200643:0:8485:0:(import.c:65:import_set_state_nolock()) ffff9ce090059000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201346.200710:0:8485:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788201346.201262:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+2:2397:x1875064662375296:12345-192.168.203.2@tcp:9:umount.0 Request processed in 684us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201346.201272:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:2.0:1788201346.201368:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662375424 00000100:00100000:2.0:1788201346.201374:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662375424 00000100:00100000:2.0:1788201346.201430:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:2.0:1788201346.201440:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:2401:x1875064662375424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201346.201453:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201346.201478:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bb400/0xf9b71aee4472050f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc00a expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.201497:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201346.201523:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2401:x1875064662375424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 87us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201346.201530:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00080000:1.0:1788201346.201911:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201346.201926:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201346.212170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201346.212288:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662375808 00000100:00100000:0.0:1788201346.212301:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662375808 00000100:00100000:0.0:1788201346.212595:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:0.0:1788201346.212610:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+7:2397:x1875064662375808:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:0.0:1788201346.212652:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720881 00000020:00010000:0.0:1788201346.212661:0:8432:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ce09005f000: total 0 00000100:00080000:0.0:1788201346.212666:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ce09005c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201346.212772:0:8432:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000020:00010000:2.0:1788201346.212787:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ce09005f000: total 0 00010000:00010000:2.0:1788201346.212867:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ce09005f000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788201346.212950:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009687503d/0xf9b71aee4472130f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3d7 expref: 5 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201346.212982:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da566c69-17bd-4938-bc1e-8b9ba2633293+4:2397:x1875064662375808:12345-192.168.203.2@tcp:9:umount.0 Request processed in 373us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201346.212991:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 82 00010000:00010000:2.0:1788201346.213006:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44720c40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1f4 expref: 3 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.213025:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ce09005f000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788201346.213041:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201346.213044:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201346.213052:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201346.213066:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201346.221784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201346.221922:0:10723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662376832 00000100:00100000:3.0:1788201346.221935:0:10723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662376832 00000100:00100000:3.0:1788201346.222014:0:10723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 258 00000100:00100000:3.0:1788201346.222028:0:10723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+22:2397:x1875064662376832:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:3.0:1788201346.222076:0:10723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720245 00000020:00010000:3.0:1788201346.222096:0:10723:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ce0bf444000: total 0 00000100:00080000:3.0:1788201346.222120:0:10723:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf446000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201346.222156:0:10723:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1788201346.222179:0:6504:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ce0bf444000: total 0 00010000:00010000:2.0:1788201346.222254:0:6504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ce0bf444000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788201346.222299:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce0b5adb300) 00010000:00010000:2.0:1788201346.222303:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201346.222313:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d000/0xf9b71aee44720571 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc018 expref: 21 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222346:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:2.0:1788201346.222349:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201346.222353:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee44720cc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc217 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201346.222361:0:10723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da566c69-17bd-4938-bc1e-8b9ba2633293+20:2397:x1875064662376832:12345-192.168.203.2@tcp:39:umount.0 Request processed in 332us (622us total) trans 4294967527 rc 0/0 00010000:00010000:2.0:1788201346.222371:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00000100:00100000:3.0:1788201346.222374:0:10723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 258 00010000:00010000:2.0:1788201346.222376:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201346.222383:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0c00/0xf9b71aee44720b21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1a7 expref: 19 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222399:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201346.222401:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201346.222405:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254e00/0xf9b71aee447212d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3c2 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222416:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201346.222418:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788201346.222421:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c600/0xf9b71aee447212fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3d0 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222432:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201346.222441:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201346.222446:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee447205e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc034 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222461:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ce0b25e5f00) 00010000:00010000:2.0:1788201346.222464:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201346.222467:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c200/0xf9b71aee44720fb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc2f0 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222481:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:2.0:1788201346.222483:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201346.222486:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44720ca9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc210 expref: 13 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222497:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201346.222500:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201346.222503:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee44720c01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1df expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222514:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cdf8193a400) 00010000:00010000:2.0:1788201346.222530:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201346.222534:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255a00/0xf9b71aee447211f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc38a expref: 11 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222549:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cdf8193b600) 00010000:00010000:2.0:1788201346.222552:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788201346.222555:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e1600/0xf9b71aee44720c2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc1ed expref: 10 pid: 10723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222584:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ce0b25e5200) 00010000:00010000:2.0:1788201346.222591:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201346.222596:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee447208e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc10d expref: 9 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222613:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce0b5adb600) 00010000:00010000:2.0:1788201346.222616:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201346.222619:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367de00/0xf9b71aee4472058d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc01f expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201346.222632:0:6504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ce0bf444000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788201346.222648:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201346.222651:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201346.222653:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201346.232688:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201346.240505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201346.242013:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662376960 00000100:00100000:0.0:1788201346.242028:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662376960 00000100:00080000:1.0:1788201346.242126:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201346.242159:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 259 00000100:00100000:0.0:1788201346.242175:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+5:2397:x1875064662376960:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:0.0:1788201346.242218:0:8476:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472024c 00000100:00080000:0.0:1788201346.242241:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9ce0bbbd9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201346.242278:0:8476:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788201346.242298:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201346.242505:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da566c69-17bd-4938-bc1e-8b9ba2633293+3:2397:x1875064662376960:12345-192.168.203.2@tcp:39:umount.0 Request processed in 335us (2016us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788201346.242537:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 259 00010000:00010000:2.0:1788201347.254241:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201348.277997:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201348.399609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201348.399901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201348.407435:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662377088 00000100:00100000:2.0:1788201348.407458:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662377088 00000100:00100000:2.0:1788201348.407680:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662377344 00000100:00100000:2.0:1788201348.407686:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662377344 00000100:00100000:0.0:1788201348.407764:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:0.0:1788201348.407788:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+11:2399:x1875064662377088:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201348.407811:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201348.407838:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44720348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf46 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.407862:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201348.407933:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:3.0:1788201348.407947:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2399:x1875064662377344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201348.407958:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788201348.407970:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+10:2399:x1875064662377088:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 186us (8376us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201348.407972:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce080031800/0xf9b71aee44720508 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc003 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201348.407988:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00010000:00010000:3.0:1788201348.407991:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201348.408016:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:2399:x1875064662377344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 74us (8116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.408023:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1788201348.411026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201348.411082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201348.411091:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662377216 00000100:00100000:0.0:1788201348.411162:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662377216 00000100:00100000:1.0:1788201348.411302:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1788201348.411316:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+8:2399:x1875064662377216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201348.411337:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201348.411364:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855ba000/0xf9b71aee4472034f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf77 expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.411388:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201348.411464:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+7:2399:x1875064662377216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 152us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201348.411471:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:3.0:1788201348.415255:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662377600 00000100:00100000:3.0:1788201348.415275:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662377600 00000100:00100000:3.0:1788201348.415388:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 260 00000100:00100000:3.0:1788201348.415401:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+6:2397:x1875064662377600:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:3.0:1788201348.415456:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472035d 00000020:00010000:3.0:1788201348.415467:0:6517:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ce0bf458800: total 0 00000100:00080000:3.0:1788201348.415473:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201348.415511:0:6517:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:2.0:1788201348.415553:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ce0bf458800: total 0 00010000:00010000:2.0:1788201348.415559:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201348.415649:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ce0bf458800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788201348.415717:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cdf8193a900) 00010000:00010000:2.0:1788201348.415723:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201348.415734:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf825e0200/0xf9b71aee4472131d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3de expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201348.415817:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ce0bf458800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788201348.415836:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201348.415836:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201348.415839:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201348.415844:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201348.416069:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1faf6d77-706d-41b4-9836-f216205de0f1+3:2397:x1875064662377600:12345-192.168.203.2@tcp:39:umount.0 Request processed in 669us (4985us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788201348.416079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 260 00000100:00100000:1.0:1788201348.433316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201348.437196:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662377728 00000100:00100000:0.0:1788201348.437217:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662377728 00000100:00100000:0.0:1788201348.437345:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 261 00000100:00100000:0.0:1788201348.437359:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1faf6d77-706d-41b4-9836-f216205de0f1+5:2397:x1875064662377728:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:0.0:1788201348.437412:0:6516:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720364 00000100:00080000:0.0:1788201348.437424:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf459800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201348.437466:0:6516:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788201348.437688:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1faf6d77-706d-41b4-9836-f216205de0f1+3:2397:x1875064662377728:12345-192.168.203.2@tcp:39:umount.0 Request processed in 323us (4376us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788201348.437697:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 261 00000100:00080000:1.0:1788201348.438136:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788201348.438318:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201348.487439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201348.487623:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662377984 00000100:00100000:3.0:1788201348.487636:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662377984 00000100:00100000:3.0:1788201348.487733:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 394 00000100:00100000:3.0:1788201348.487790:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+7:2397:x1875064662377984:12345-192.168.203.2@tcp:251:umount.0 00000020:00000080:3.0:1788201348.487852:0:6511:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720222 00000020:00010000:3.0:1788201348.487863:0:6511:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ce0bf446800: total 0 00000100:00080000:3.0:1788201348.488271:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788201348.488381:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96646b6c-1f38-4253-ba71-8fb9a5b4735a+3:2397:x1875064662377984:12345-192.168.203.2@tcp:251:umount.0 Request processed in 594us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.488391:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 394 00000020:00010000:1.0:1788201348.488823:0:7466:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ce0bf446800: total 0 00010000:00010000:1.0:1788201348.488903:0:7466:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ce0bf446800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788201348.488945:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255c00/0xf9b71aee4472027d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bbf38 expref: 2 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.488963:0:7466:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ce0bf446800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788201348.488975:0:7466:0:(genops.c:906:class_export_put()) final put ffff9ce0bf446800/96646b6c-1f38-4253-ba71-8fb9a5b4735a 00010000:00010000:1.0:1788201348.488991:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201348.488993:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201348.488994:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201348.489231:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf446800/96646b6c-1f38-4253-ba71-8fb9a5b4735a for MGS 00000020:00000080:3.0:1788201348.489279:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf443000 for MGS 00000100:00100000:0.0:1788201348.726411:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681296384:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726534:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681296896:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726572:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681297408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726604:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681297920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201348.726623:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726643:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201348.726648:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681296512:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726692:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681297024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726718:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681297536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726772:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681296640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726791:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726801:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681297152:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726818:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726831:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681297664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726846:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726858:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788201348.726863:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681296256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726882:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726898:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681296768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726939:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681297280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726954:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.726966:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681297792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.726980:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.727002:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681296384 00000100:00100000:0.0:1788201348.727008:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681296384 00000100:00100000:0.0:1788201348.727037:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681296896 00000100:00100000:0.0:1788201348.727039:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681296896 00000100:00100000:0.0:1788201348.727055:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681297408 00000100:00100000:0.0:1788201348.727057:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681297408 00000100:00100000:0.0:1788201348.727065:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681297024 00000100:00100000:0.0:1788201348.727067:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681297024 00000100:00100000:0.0:1788201348.727077:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681297536 00000100:00100000:0.0:1788201348.727079:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681297536 00000100:00100000:0.0:1788201348.727090:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681296640 00000100:00100000:0.0:1788201348.727092:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681296640 00000100:00100000:0.0:1788201348.727105:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788201348.727112:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681296384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.727158:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681296384:12345-0@lo:400:kworker.0 Request processed in 45us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.727164:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788201348.727178:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788201348.727183:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681296896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.727203:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681296896:12345-0@lo:400:kworker.0 Request processed in 20us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.727209:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788201348.727217:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788201348.727228:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681297408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201348.727250:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681297408:12345-0@lo:400:kworker.0 Request processed in 23us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.727255:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788201348.727264:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788201348.727269:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681297024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.728525:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681297152 00000100:00100000:3.0:1788201348.728535:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681297152 00000100:00100000:3.0:1788201348.728563:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681297664 00000100:00100000:3.0:1788201348.728565:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681297664 00000100:00100000:3.0:1788201348.728575:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681297280 00000100:00100000:3.0:1788201348.728577:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681297280 00000100:00100000:3.0:1788201348.728587:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681297792 00000100:00100000:3.0:1788201348.728590:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681297792 00000100:00100000:3.0:1788201348.728602:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788201348.728610:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681297152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.728687:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681297152:12345-0@lo:400:kworker.0 Request processed in 78us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.728693:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788201348.728758:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201348.728764:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681297664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.728789:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681297664:12345-0@lo:400:kworker.0 Request processed in 26us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.728803:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201348.728812:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201348.728817:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681297280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.728839:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681297280:12345-0@lo:400:kworker.0 Request processed in 22us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.728844:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201348.728852:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788201348.728857:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681297792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.728875:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681297792:12345-0@lo:400:kworker.0 Request processed in 19us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.728880:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788201348.728895:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681296512 00000100:00100000:3.0:1788201348.728898:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681296512 00000100:00100000:3.0:1788201348.728919:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681296768 00000100:00100000:3.0:1788201348.728922:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681296768 00000100:00100000:3.0:1788201348.728931:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788201348.728936:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681296512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.728961:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681296512:12345-0@lo:400:kworker.0 Request processed in 25us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.728966:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788201348.728974:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788201348.728979:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681296768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.728998:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681296768:12345-0@lo:400:kworker.0 Request processed in 20us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.729003:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788201348.729029:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788201348.729035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681297536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.729062:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681297536:12345-0@lo:400:kworker.0 Request processed in 27us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.729067:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788201348.729079:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788201348.729084:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681296640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.729109:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681296640:12345-0@lo:400:kworker.0 Request processed in 24us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.729115:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788201348.730300:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681297920 00000100:00100000:3.0:1788201348.730309:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681297920 00000100:00100000:3.0:1788201348.730350:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201348.730360:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681297920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201348.730386:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201348.730438:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681297920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (3812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.730444:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201348.730485:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681296256 00000100:00100000:3.0:1788201348.730488:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681296256 00000100:00100000:3.0:1788201348.730515:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788201348.730521:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681296256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730553:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a088f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3644:x1875064681296256:12345-0@lo:400:kworker.0 Request processed in 32us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.730559:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788201348.730623:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3644:1875064681296256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730647:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681296768:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730668:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681297280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730677:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681297792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730687:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681296640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730696:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681297152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730705:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681297664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730764:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681296512:0@lo:400:kworker.0 00010000:00080000:3.0:1788201348.730777:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8410d880 x1875064681297536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201348.730788:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681297536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730798:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681296384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730808:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681296896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730818:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681297408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.730831:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681297920:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201348.731533:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201348.731539:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201348.731542:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201348.731550:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201348.732955:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681297024:12345-0@lo:400:kworker.0 Request processed in 5679us (6241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.732967:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00080000:1.0:1788201348.733417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8410e680 x1875064681297024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201348.733431:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681297024:0@lo:400:kworker.0 00000040:00080000:2.0:1788201348.918416:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788201348.982846:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201348.982860:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201348.982991:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788201348.983002:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788201349.249510:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201349.249542:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681298048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201349.249642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201349.249732:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681298048 00000100:00100000:3.0:1788201349.249761:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681298048 00000100:00100000:3.0:1788201349.249986:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201349.250007:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681298048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201349.250040:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201349.250345:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681298048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 339us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201349.250352:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788201349.250872:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681298048:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201349.307438:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201350.143014:0:15252:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788201350.172247:0:15252:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788201350.172324:0:15252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.172342:0:15252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.172352:0:15252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.172361:0:15252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.172388:0:15252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201350.172394:0:15252:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201350.172431:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201350.172438:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788201350.172439:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1788201350.172447:0:15252:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788201350.172455:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.172477:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201350.172482:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.172492:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201350.172498:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9ce0b322e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:2.0:1788201350.172501:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201350.172508:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201350.172512:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201350.172518:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788201350.172550:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681298176:0@lo:39:umount.0 00010000:00010000:2.0:1788201350.172565:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.172591:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201350.172627:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.172634:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74400/0xf9b71aee447202d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.172658:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201350.172659:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201350.172661:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201350.172671:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201350.172690:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681298304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201350.172780:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201350.173902:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681298304 00000100:00100000:3.0:1788201350.173911:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681298304 00000100:00100000:3.0:1788201350.173965:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201350.173975:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3645:x1875064681298304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201350.173989:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201350.174004:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0400/0xf9b71aee447202df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447202d8 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201350.174019:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201350.174072:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+23:3645:x1875064681298304:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201350.174078:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201350.174691:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681298304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201350.176446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201350.176787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681298176 00000100:00100000:3.0:1788201350.176799:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681298176 00000100:00100000:3.0:1788201350.178826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788201350.178848:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875064681298176:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201350.178885:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fe39 00000100:00080000:3.0:1788201350.178893:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ce0b95b8800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201350.178957:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201350.179009:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875064681298176:12345-0@lo:39:umount.0 Request processed in 170us (2570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201350.179019:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788201350.179032:0:6517:0:(genops.c:906:class_export_put()) final put ffff9ce0b95bd000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788201350.179054:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b322e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201350.179077:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681298176:0@lo:39:umount.0 00000020:00000080:2.0:1788201350.179113:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b95bd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201350.179165:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b95b8800 for lustre-MDT0000 00000100:00080000:0.0:1788201350.179207:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201350.179213:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201350.179219:0:15252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788201350.181278:0:15252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181302:0:15252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181310:0:15252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181317:0:15252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181341:0:15252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201350.181348:0:15252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181355:0:15252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181361:0:15252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181387:0:15252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181403:0:15252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201350.181419:0:15252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181427:0:15252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181446:0:15252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181453:0:15252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181473:0:15252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201350.181496:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201350.181503:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181512:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855baa00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201350.181515:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181526:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201350.181534:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201350.181547:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201350.181550:0:7466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788201350.181607:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181615:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201350.181669:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181682:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee447202e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181702:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201350.181706:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181727:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1600 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201350.181731:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.181767:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201350.181771:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.181782:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201350.181783:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.181812:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c400 already unused, calling callback (ffffffffc1519c20) 10000000:01000000:0.0:1788201350.181813:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201350.181822:0:7466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:00010000:2.0:1788201350.181824:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201350.181826:0:7466:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788201350.181837:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201350.181847:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181859:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181868:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1788201350.181881:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788201350.181885:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788201350.181889:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788201350.181895:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181906:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1600/0xf9b71aee447201dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447201e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181932:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201350.181935:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201350.181936:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.181938:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201350.181950:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201350.181965:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681298560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201350.181969:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.181979:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44720540 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44720547 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201350.181995:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201350.181997:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201350.182000:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201350.182023:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681298688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201350.182066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201350.182104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201350.182173:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681298560 00000100:00100000:0.0:1788201350.182182:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681298560 00000100:00100000:2.0:1788201350.182185:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681298688 00000100:00100000:2.0:1788201350.182194:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681298688 00000100:00100000:2.0:1788201350.182257:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201350.182268:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3647:x1875064681298688:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201350.182280:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788201350.182282:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788201350.182295:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c49adc14-d6d0-415b-83c4-8895eee6f8a8+24:3646:x1875064681298560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201350.182303:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255200/0xf9b71aee44720547 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44720540 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182310:0:13184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201350.182320:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201350.182331:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce081671000/0xf9b71aee447201e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447201dc expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182346:0:13184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201350.182366:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3647:x1875064681298688:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201350.182385:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201350.182402:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3646:x1875064681298560:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201350.182411:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201350.182449:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3647:1875064681298688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201350.182464:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681298560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201350.182484:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201350.182508:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681298432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201350.182547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201350.182592:0:15252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182603:0:15252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182610:0:15252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182616:0:15252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182630:0:15252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201350.182635:0:15252:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788201350.182638:0:15252:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788201350.182691:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201350.182696:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182703:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081671400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201350.182706:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182715:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201350.182722:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201350.182728:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201350.182767:0:7466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788201350.182770:0:7466:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788201350.182791:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182798:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201350.182813:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182820:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081671400/0xf9b71aee4471fd98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4471fd9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201350.182830:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201350.182832:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201350.182834:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201350.182843:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201350.182850:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681298816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201350.182876:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788201350.182914:0:15252:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788201350.182920:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788201350.182926:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201350.182933:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788201350.182940:0:15252:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce0bf440000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201350.182947:0:15252:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9cdf819d4000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201350.182952:0:15252:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce0c1dcb800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201350.182957:0:15252:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce09e18a800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1788201350.182964:0:15252:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9ce0bf458800 1faf6d77-706d-41b4-9836-f216205de0f1 192.168.203.2@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201350.182970:0:15252:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9ce0bf444000 da566c69-17bd-4938-bc1e-8b9ba2633293 192.168.203.2@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:0.0:1788201350.182985:0:15252:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9ce0b2524d40) has exports, disconnecting them 00000020:00080000:0.0:1788201350.182989:0:15252:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce0bf440000), last request at 1788201348 00000020:00000080:0.0:1788201350.182997:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720149 00000100:00080000:0.0:1788201350.183016:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf441800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201350.183321:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681298432 00000100:00100000:2.0:1788201350.183331:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681298432 00000100:00100000:2.0:1788201350.183375:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681298816 00000100:00100000:2.0:1788201350.183379:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681298816 00000100:00100000:2.0:1788201350.183418:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201350.183429:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+22:3645:x1875064681298432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201350.183441:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1788201350.183445:0:15252:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0bf440000): rc 0 00000020:00000080:0.0:1788201350.183450:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0bf440000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788201350.183467:0:15252:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cdf819d4000), last request at 1788201348 00010000:00010000:2.0:1788201350.183474:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0a00/0xf9b71aee447202ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447202e6 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788201350.183474:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472002a 00000100:00080000:0.0:1788201350.183484:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9cdf819d0800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788201350.183499:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1788201350.183517:0:15252:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf819d4000): rc 0 00000020:00000080:0.0:1788201350.183521:0:15252:0:(genops.c:906:class_export_put()) final put ffff9cdf819d4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788201350.183527:0:15252:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce0c1dcb800), last request at 1788201120 00000020:00000080:0.0:1788201350.183530:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471ff20 00000100:00080000:0.0:1788201350.183536:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1dca000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201350.183549:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201350.183556:0:15252:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0c1dcb800): rc 0 00000020:00000080:0.0:1788201350.183558:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0c1dcb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788201350.183561:0:15252:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce09e18a800), last request at 1788201120 00000020:00000080:0.0:1788201350.183565:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471feef 00000100:00080000:0.0:1788201350.183569:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9491800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201350.183577:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788201350.183584:0:15252:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1788201350.183613:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201350.183635:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+21:3645:x1875064681298816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201350.183658:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201350.183669:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0816a0800/0xf9b71aee4471fd9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4471fd98 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201350.183680:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1788201350.183821:0:15252:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce09e18a800): rc 0 00000004:00000080:0.0:1788201350.183829:0:15252:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc1518193bae0 00000100:00080000:0.0:1788201350.183850:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788201350.183853:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1788201350.184699:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49adc14-d6d0-415b-83c4-8895eee6f8a8+20:3645:x1875064681298432:12345-0@lo:103:ldlm_bl.0 Request processed in 1268us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201350.184710:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788201350.184769:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201350.184782:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf440000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201350.184838:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf819d4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201350.184878:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0c1dcb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201350.184901:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf441800 for lustre-MDT0000 00000020:00000080:2.0:1788201350.184905:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf819d0800 for lustre-MDT0000 00000020:00000080:2.0:1788201350.184908:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0c1dca000 for lustre-MDT0000 00010000:00010000:2.0:1788201350.184931:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201350.185082:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c49adc14-d6d0-415b-83c4-8895eee6f8a8+19:3645:x1875064681298816:12345-0@lo:103:ldlm_bl.0 Request processed in 1448us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201350.185091:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201350.185153:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681298816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201350.185165:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681298432:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788201350.186538:0:15252:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788201350.186580:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9ce0ba06a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201350.187541:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681298944:0@lo:39:umount.0 00000100:00080000:1.0:1788201350.187695:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201350.187700:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000100:00100000:2.0:1788201350.187710:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201350.187722:0:15252:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201350.187812:0:15252:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201350.187833:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201350.187844:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201350.187847:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788201350.187854:0:15252:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201350.187884:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681299072:0@lo:9:umount.0 00000100:00080000:1.0:1788201350.187915:0:15252:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201350.187925:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9ce0a64be000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201350.187957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201350.187981:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681299200:0@lo:9:umount.0 00000020:00080000:1.0:1788201350.188000:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9ce0b2524d40) has no exports 00000100:00100000:2.0:1788201350.188006:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201350.188049:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681298944 00000100:00100000:2.0:1788201350.188056:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681298944 00000100:00100000:2.0:1788201350.188167:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788201350.188180:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875064681298944:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201350.188204:0:9551:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471ff7b 00000100:00080000:2.0:1788201350.188211:0:9551:0:(import.c:65:import_set_state_nolock()) ffff9ce0ba06f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201350.188240:0:9551:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788201350.188317:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681299072 00000100:00100000:3.0:1788201350.188322:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681299072 00000100:00100000:3.0:1788201350.188357:0:8485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681299200 00000100:00100000:3.0:1788201350.188360:0:8485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681299200 00000100:00100000:3.0:1788201350.188384:0:8485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201350.188393:0:8485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875064681299072:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201350.188410:0:8485:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447200cb 00000100:00080000:3.0:1788201350.188415:0:8485:0:(import.c:65:import_set_state_nolock()) ffff9cdf81970800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201350.188450:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3643:x1875064681298944:12345-0@lo:39:umount.0 Request processed in 271us (743us total) trans 4294967301 rc 0/0 00000001:00000004:3.0:1788201350.188453:0:8485:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1788201350.188464:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00010000:1.0:1788201350.188547:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201350.188564:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0ba06a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201350.188576:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681298944:0@lo:39:umount.0 00000100:00100000:0.0:1788201350.188895:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201350.188924:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875064681299200:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201350.188961:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472020d 00000100:00080000:0.0:1788201350.188972:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9cdf831fc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201350.189003:0:8432:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:1.0:1788201350.191826:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201350.191838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201350.194151:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201350.195701:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1875064681299200:12345-0@lo:9:umount.0 Request processed in 6772us (7685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201350.195702:0:8485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3643:x1875064681299072:12345-0@lo:9:umount.0 Request processed in 7300us (7735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201350.195723:0:8485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201350.195730:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1788201350.195779:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201350.196115:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a64be000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201350.196139:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201350.196142:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201350.196146:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681299200:0@lo:9:umount.0 00000100:00080000:1.0:1788201350.196160:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201350.196174:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201350.196192:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201350.196195:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681299072:0@lo:9:umount.0 00000020:00080000:1.0:1788201350.204888:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9ce0b2524d40) has no exports 00000020:00000080:1.0:1788201350.300113:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fdf3 00000020:00000080:1.0:1788201350.300209:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0b94f8000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788201350.300279:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788201350.300330:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201350.300341:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201350.300345:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9ce0a6438000) has no exports 00000020:00000080:0.0:1788201350.300650:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fdec 00000020:00000080:0.0:1788201350.300656:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0b9493000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201350.304308:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b94f8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788201350.307147:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9493000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201350.308269:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201350.308285:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201350.308291:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0b9494000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788201350.308295:0:15252:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9494000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788201350.308306:0:15252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788201350.325937:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201350.774076:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201350.774100:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681299328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201350.774174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201350.774349:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681299328 00000100:00100000:3.0:1788201350.774356:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681299328 00000100:00100000:3.0:1788201350.774404:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788201350.774424:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875064681299328:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788201350.774431:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201350.774482:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875064681299328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (306us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201350.774489:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:02020000:1.0:1788201350.774672:0:3644:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788201350.779572:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201350.779584:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1dcd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201350.779590:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201350.801113:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1dcd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201350.801134:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 200 00000100:00080000:1.0:1788201350.801148:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce0c1dcd800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201350.801242:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf841bad80 x1875064681299456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201350.801348:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681299456:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788201350.801428:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201350.801580:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681299456 00000100:00100000:3.0:1788201350.801588:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681299456 00000100:00100000:3.0:1788201350.801632:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788201350.801649:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf825fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681299456:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788201350.801676:0:6521:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788201350.805655:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf825fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681299456:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 3981us (4201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201350.805674:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:2.0:1788201350.806328:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1dcd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201350.806337:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201350.806342:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681299456:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201351.286376:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681299584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201351.286477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201351.287882:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681299584 00000100:00100000:0.0:1788201351.287897:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681299584 00000100:00100000:0.0:1788201351.288273:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201351.288287:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681299584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201351.288334:0:15165:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788201351.288437:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681299584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201351.288445:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788201351.288685:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201351.289016:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681299584:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201351.350392:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201351.806499:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201351.806533:0:8425:0:(genops.c:906:class_export_put()) final put ffff9cdf81975000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788201351.806577:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:1.0:1788201351.806580:0:8425:0:(genops.c:906:class_export_put()) final put ffff9ce09005f000/da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:1.0:1788201351.806621:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf81975000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788201351.806691:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09005f000/da566c69-17bd-4938-bc1e-8b9ba2633293 for lustre-OST0000 00000020:00000080:1.0:1788201351.806718:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf81970800 for lustre-OST0000 00000020:00000080:1.0:1788201351.806723:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce09005c800 for lustre-OST0000 00000001:00100000:0.0:1788201351.812773:0:6495:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201351.812784:0:6495:0:(genops.c:906:class_export_put()) final put ffff9ce09e18a800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788201351.812812:0:6495:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1faf6d77-706d-41b4-9836-f216205de0f1 00000001:00080000:0.0:1788201351.812824:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788201351.812828:0:6495:0:(genops.c:906:class_export_put()) final put ffff9ce0bf458800/1faf6d77-706d-41b4-9836-f216205de0f1 00000001:00100000:0.0:1788201351.812834:0:6495:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000001:00080000:0.0:1788201351.812847:0:6495:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788201351.812855:0:6495:0:(genops.c:906:class_export_put()) final put ffff9ce0bf444000/da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:2.0:1788201351.813008:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e18a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201351.813088:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf458800/1faf6d77-706d-41b4-9836-f216205de0f1 for lustre-MDT0000 00000020:00000080:2.0:1788201351.813115:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf444000/da566c69-17bd-4938-bc1e-8b9ba2633293 for lustre-MDT0000 00000020:00000080:2.0:1788201351.813140:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b9491800 for lustre-MDT0000 00000020:00000080:2.0:1788201351.813144:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf45c800 for lustre-MDT0000 00000020:00000080:2.0:1788201351.813148:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf446000 for lustre-MDT0000 00000001:00100000:2.0:1788201351.815295:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201351.815305:0:9511:0:(genops.c:906:class_export_put()) final put ffff9cdf831fe800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788201351.815333:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:2.0:1788201351.815335:0:9511:0:(genops.c:906:class_export_put()) final put ffff9ce09005b800/da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:3.0:1788201351.815466:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf831fe800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788201351.815517:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09005b800/da566c69-17bd-4938-bc1e-8b9ba2633293 for lustre-OST0001 00000020:00000080:3.0:1788201351.815542:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf831fc800 for lustre-OST0001 00000020:00000080:3.0:1788201351.815546:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce090059000 for lustre-OST0001 00000001:00100000:0.0:1788201351.815822:0:7447:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788201351.815834:0:7447:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788201351.815838:0:7447:0:(genops.c:906:class_export_put()) final put ffff9ce0c1fc2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788201351.815854:0:7447:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1faf6d77-706d-41b4-9836-f216205de0f1 00000001:00080000:0.0:1788201351.815858:0:7447:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788201351.815861:0:7447:0:(genops.c:906:class_export_put()) final put ffff9ce0bf45a000/1faf6d77-706d-41b4-9836-f216205de0f1 00000001:00100000:0.0:1788201351.815865:0:7447:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of da566c69-17bd-4938-bc1e-8b9ba2633293 00000001:00080000:0.0:1788201351.815868:0:7447:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788201351.815870:0:7447:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbde800/da566c69-17bd-4938-bc1e-8b9ba2633293 00000020:00000080:3.0:1788201351.815920:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0c1fc2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788201351.815957:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf45a000/1faf6d77-706d-41b4-9836-f216205de0f1 for lustre-MDT0001 00000020:00000080:3.0:1788201351.815978:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbde800/da566c69-17bd-4938-bc1e-8b9ba2633293 for lustre-MDT0001 00000020:00000080:3.0:1788201351.815998:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0ba06f000 for lustre-MDT0001 00000020:00000080:3.0:1788201351.816002:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf459800 for lustre-MDT0001 00000020:00000080:3.0:1788201351.816005:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bbbd9000 for lustre-MDT0001 00000020:01000000:1.0:1788201352.310021:0:15252:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf8310e060 - data ffff9ce0abdb3870/ffff9cdf83265400 00000020:01000000:1.0:1788201352.310193:0:15252:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ce0b94ee300 - data ffff9ce0abd64870/ffff9ce0b95c1400 00000001:00000004:1.0:1788201352.320233:0:15252:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:2.0:1788201352.380322:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201352.380918:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788201352.380927:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788201352.380945:0:15252:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ce0bf4e9180 x1875064681298944/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201360 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201352.380977:0:15252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788201352.388606:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201352.388616:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:0.0:1788201352.388638:0:15252:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201352.388641:0:15252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201352.389239:0:8482:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201352.389246:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788201352.389259:0:8482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788201352.391401:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201352.391411:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788201352.391651:0:15252:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201352.391656:0:15252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201352.392222:0:9980:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201352.392229:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788201352.392243:0:9980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788201352.393337:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fdbb 00000020:00000080:0.0:1788201352.393347:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce09e18e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201352.395250:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e18e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201352.402193:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fdd0 00000020:00000080:3.0:1788201352.402213:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce09e1d8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788201352.402547:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788201352.402556:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201352.402570:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201352.402593:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9ce0b2523380) has no exports 00000004:01000000:3.0:1788201352.402852:0:15252:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788201352.402864:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720206 00000020:00000080:3.0:1788201352.402871:0:15252:0:(genops.c:906:class_export_put()) final put ffff9cdf83353800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201352.402974:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e1d8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788201352.404415:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788201352.404537:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201352.404557:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201352.404562:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff9ce0b9700000) has no exports 00000020:00000080:3.0:1788201352.404574:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447201ff 00000020:00000080:3.0:1788201352.404583:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0a64bb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201352.404677:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf83353800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788201352.405366:0:15252:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788201352.405373:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201352.405378:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788201352.405387:0:15252:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201352.405390:0:15252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201352.405490:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a64bb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201352.405670:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201352.405684:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201352.405696:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447200c4 00000020:00000080:3.0:1788201352.405707:0:15252:0:(genops.c:906:class_export_put()) final put ffff9cdf81972000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201352.405730:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a64be000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201352.405764:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0a64ba000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201352.405767:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a64ba000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788201352.405779:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788201352.405900:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788201352.405920:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201352.405929:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201352.405934:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9ce0bf454d40) has no exports 00000020:00000080:3.0:1788201352.405941:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447200bd 00000020:00000080:3.0:1788201352.405950:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0b6c06000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201352.406327:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf81972000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201352.406357:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b6c06000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788201352.408918:0:15252:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788201352.408926:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201352.408929:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:3.0:1788201352.408937:0:15252:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201352.408939:0:15252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201352.408990:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201352.409001:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788201352.409031:0:15252:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788201352.409039:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471ff74 00000020:00000080:3.0:1788201352.409047:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0b3150000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788201352.409053:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788201352.409057:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201352.409061:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201352.409064:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9ce0ba0f99c0) has no exports 00000020:00000080:3.0:1788201352.409071:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471ff6d 00000020:00000080:3.0:1788201352.409074:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0ba06b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201352.410089:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf45e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201352.410106:0:493:0:(genops.c:906:class_export_put()) final put ffff9cdf819d2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201352.410110:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf819d2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788201352.410119:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201352.410344:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3150000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788201352.410360:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0ba06b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788201352.417441:0:15252:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788201352.417450:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201352.417455:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788201352.417464:0:15252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201352.417528:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201352.417540:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201352.417568:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201352.417571:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201352.417577:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce09e188800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201352.417582:0:15252:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e188800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201352.417594:0:15252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201352.417680:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0ba06a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788201352.417687:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0ba06d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201352.417689:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0ba06d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788201352.417708:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201352.422450:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fdd7 00000020:00000080:2.0:1788201352.422465:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce09e1dc000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788201352.422487:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788201352.422495:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201352.422504:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201352.422508:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9ce0b25219c0) has no exports 00000020:00000080:2.0:1788201352.422534:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201352.422540:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788201352.422545:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fdde 00000020:00000080:2.0:1788201352.422549:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce09e1dd000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788201352.422559:0:15252:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0889be000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788201352.422576:0:15252:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0889be000 3 00000020:01000004:2.0:1788201352.422580:0:15252:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce0889be000 from lustre-MDT0000 00000020:00000080:2.0:1788201352.422611:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201352.422615:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788201352.422618:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce09e18b000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788201352.422621:0:15252:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e18b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788201352.422640:0:15252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1788201352.422700:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e1dc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788201352.422705:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce09e189000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788201352.422707:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e189000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788201352.422712:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788201352.422724:0:15252:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788201352.422729:0:15252:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788201352.422732:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788201352.422734:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201352.422749:0:15252:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201352.422756:0:15252:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9ce0b3253800 c49adc14-d6d0-415b-83c4-8895eee6f8a8 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201352.422762:0:15252:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9ce0a643cd40) has exports, disconnecting them 00000020:00080000:2.0:1788201352.422767:0:15252:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ce0b3253800), last request at 1788201101 00000020:00000080:0.0:1788201352.422768:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e1dd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201352.422781:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fd7c 00000020:00010000:2.0:1788201352.422785:0:15252:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ce0b3253800: total 0 00000100:00080000:2.0:1788201352.422789:0:15252:0:(import.c:65:import_set_state_nolock()) ffff9ce0b3252000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201352.422806:0:15252:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0b3253800): rc 0 00000020:00080000:2.0:1788201352.422810:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9ce0a643cd40) has no exports 00000020:00010000:0.0:1788201352.422872:0:7466:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ce0b3253800: total 0 00010000:00010000:0.0:1788201352.422897:0:7466:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ce0b3253800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788201352.422927:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce080030800/0xf9b71aee4472052b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44720524 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.422944:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1800/0xf9b71aee447202fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447202f4 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.422954:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce080030000/0xf9b71aee44720539 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44720532 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.422963:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75a00/0xf9b71aee4472019d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44720196 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.422976:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74000/0xf9b71aee4472028b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44720284 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.422986:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74800/0xf9b71aee44720299 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44720292 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.422995:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255000/0xf9b71aee447202a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447202a0 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.423005:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0600/0xf9b71aee447202b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447202ae expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.423024:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0c2045600/0xf9b71aee4471fe78 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4471fe71 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.423035:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254600/0xf9b71aee447202d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447202ca expref: 5 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.423043:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0c2044400/0xf9b71aee4471fe86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4471fe7f expref: 4 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.423055:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee4472051d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44720516 expref: 3 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.423065:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bb000/0xf9b71aee447202c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447202bc expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201352.423074:0:7466:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ce0b3253800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788201352.423089:0:7466:0:(genops.c:906:class_export_put()) final put ffff9ce0b3253800/c49adc14-d6d0-415b-83c4-8895eee6f8a8 00010000:00010000:0.0:1788201352.423105:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201352.423108:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201352.423110:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201352.425784:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ce086382e00:6511] 2 exiting: rc = 0 00000100:00100000:3.0:1788201352.426126:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ce0839caa00:6510] 1 exiting: rc = 0 00000100:00100000:3.0:1788201352.426195:0:6509:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ce086382000:6509] 0 exiting: rc = 1 00000100:00100000:0.0:1788201352.426256:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426267:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426273:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426285:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426303:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426310:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426315:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426321:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426327:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426332:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426348:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426353:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426358:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426364:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426369:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426374:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426380:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426388:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426394:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426400:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426405:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426410:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426416:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426423:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426428:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426433:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788201352.426438:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3253800/c49adc14-d6d0-415b-83c4-8895eee6f8a8 for MGS 00000100:00100000:0.0:1788201352.426439:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426444:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426449:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426454:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426459:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426465:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426470:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788201352.426475:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b3252000 for MGS 00000100:00100000:0.0:1788201352.426475:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426480:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426485:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426490:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426496:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426501:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426505:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426510:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426515:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426520:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426524:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426529:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426544:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426549:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426555:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426560:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426565:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426571:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426588:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426595:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426600:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426605:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426610:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426615:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426619:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426633:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426639:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426644:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426650:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426655:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201352.426660:0:15252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788201352.428248:0:15252:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf8310ea20 - data ffff9ce0abf320d8/ffff9cdf83267800 00000020:01000000:0.0:1788201352.428374:0:15252:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ce09d9d58a0 - data ffff9ce0986ad870/ffff9ce0aae8f400 00000020:00000080:0.0:1788201352.428954:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fd60 00000020:00000080:0.0:1788201352.428963:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0a1aa6000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788201352.428982:0:15252:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0889be000 from MGS, refs=2 00000020:01000004:0.0:1788201352.428986:0:15252:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0889be000 2 00000020:01000004:0.0:1788201352.428989:0:15252:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce0889be000 from MGS 00000020:00000080:0.0:1788201352.429024:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201352.429031:0:15252:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788201352.429033:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce08341f800/MGS 00000020:00000080:0.0:1788201352.429036:0:15252:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce08341f800/MGS for MGS 00000020:01000000:0.0:1788201352.429043:0:15252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788201352.429098:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788201352.429101:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201352.429106:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201352.429119:0:15252:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ce0b322c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201352.429125:0:15252:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9ce0a643b380) has exports, disconnecting them 00000020:00080000:0.0:1788201352.429129:0:15252:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ce0b322c800), last request at 1788201101 00000020:00000080:0.0:1788201352.429132:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fe2b 00000020:00080000:0.0:1788201352.429141:0:15252:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0b322c800): rc 0 00000020:00000080:0.0:1788201352.429145:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0b322c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788201352.429226:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a1aa6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201352.429233:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b322c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788201352.434800:0:15252:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788201352.434808:0:15252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201352.434812:0:15252:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201352.434820:0:15252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201352.434853:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b322e800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788201352.434999:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201352.435017:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788201352.435022:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce0a0864000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788201352.435025:0:15252:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a0864000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788201352.435031:0:15252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788201352.435108:0:15252:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0889be000 1 00000020:00000080:2.0:1788201352.435114:0:15252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fd52 00000020:00000080:2.0:1788201352.435119:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce083419000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788201352.435128:0:15252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788201352.435135:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce083419000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201352.435143:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201352.435147:0:15252:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201352.435151:0:15252:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9ce0a6584d40) has no exports 00000020:00000080:0.0:1788201352.679199:0:15252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201352.679213:0:15252:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788201352.679219:0:15252:0:(genops.c:906:class_export_put()) final put ffff9ce098298000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201352.679224:0:15252:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce098298000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201352.679229:0:15252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788201352.679347:0:15252:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce0889bd800 00000020:02000400:0.0:1788201352.679410:0:15252:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788201353.399551:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201353.845873:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201353.845880:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201353.845884:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1dcd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201353.845892:0:493:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1788201353.845897:0:493:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201353.845905:0:493:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce0c1dcd800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201353.845928:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf825fe300 x1875064681299840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201353.846019:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681299840:0@lo:38:kworker.0 00000100:00100000:2.0:1788201353.846084:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201353.846164:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681299968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201353.846192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201353.846218:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681300480:0@lo:400:kworker.0 00000100:00100000:2.0:1788201353.846238:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201353.846269:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201353.846275:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681300096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201353.846298:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201353.846313:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681300608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201353.846331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201353.846376:0:9551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681299840 00000100:00100000:2.0:1788201353.846383:0:9551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681299840 00000100:00100000:2.0:1788201353.846421:0:9551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788201353.846429:0:9551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875064681299840:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201353.846462:0:9551:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201353.846504:0:9551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875064681299840:12345-0@lo:38:kworker.0 Request processed in 74us (419us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201353.846650:0:9551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788201353.846674:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681299968 00000100:00100000:2.0:1788201353.846679:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681299968 00000100:00100000:2.0:1788201353.846787:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681300480 00000100:00100000:2.0:1788201353.846791:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681300480 00000100:00100000:2.0:1788201353.846799:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681300096 00000100:00100000:2.0:1788201353.846801:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681300096 00000100:00100000:2.0:1788201353.846807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681300608 00000100:00100000:2.0:1788201353.846809:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681300608 00000100:00100000:2.0:1788201353.846830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788201353.846838:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681300608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201353.846881:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681300608:12345-0@lo:400:kworker.0 Request processed in 45us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201353.846887:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788201353.846899:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788201353.846903:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875064681299968:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201353.846914:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201353.846937:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875064681299968:12345-0@lo:400:kworker.0 Request processed in 33us (745us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201353.846943:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788201353.846953:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788201353.846957:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875064681300480:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201353.846961:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201353.846980:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875064681300480:12345-0@lo:400:kworker.0 Request processed in 22us (742us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201353.846985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788201353.846994:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788201353.846997:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875064681300096:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201353.847002:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201353.847020:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875064681300096:12345-0@lo:400:kworker.0 Request processed in 21us (722us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201353.847025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1788201353.847058:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1dcd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201353.847063:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201353.847067:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681299840:0@lo:38:kworker.0 00000100:00080000:2.0:1788201353.847098:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201353.847101:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ce0aafdc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201353.847105:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788201353.848707:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681300224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.848781:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201353.848828:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681300736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.848854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201353.848879:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201353.848886:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681299712:0@lo:400:kworker.0 00000400:00000100:1.0:1788201353.848906:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064681299712 offset 0 length 224: 4 00000100:00100000:1.0:1788201353.848923:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681300352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.848944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201353.848975:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681300224 00000100:00100000:1.0:1788201353.848981:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681300224 00000100:00100000:1.0:1788201353.849023:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788201353.849032:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681300224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.849077:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681300224:12345-0@lo:400:kworker.0 Request processed in 46us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201353.849084:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:1.0:1788201353.849116:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201353.849131:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681300736 00000100:00100000:1.0:1788201353.849134:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681300736 00000100:00100000:1.0:1788201353.849164:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681300352 00000100:00100000:1.0:1788201353.849167:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681300352 00000100:00100000:1.0:1788201353.849187:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201353.849193:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681300736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.849227:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681300736:12345-0@lo:400:kworker.0 Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201353.849233:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201353.849243:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201353.849249:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681300352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.849274:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681300352:12345-0@lo:400:kworker.0 Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201353.849279:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1788201353.849301:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201353.849303:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201353.849326:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681300352:0@lo:400:kworker.0 00010000:00080000:1.0:1788201353.849339:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9cdf841c7100 x1875064681300224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201353.849349:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681300224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.849358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681300736:0@lo:400:kworker.0 00000100:00080000:2.0:1788201353.875906:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ce0aafdc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201353.875925:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 220 00000100:00080000:2.0:1788201353.875939:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ce0aafdc800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201353.893717:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf841c7100 x1875064681300864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201353.893770:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681300096:0@lo:400:kworker.0 00010000:00080000:1.0:1788201353.893823:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9cdf837a7100 x1875064681300608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201353.893836:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681300608:0@lo:400:kworker.0 00000100:00080000:1.0:1788201353.893850:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201353.893855:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1fc5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201353.893859:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201353.893864:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1fc5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201353.893868:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 200 00000100:00080000:1.0:1788201353.893876:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ce0c1fc5000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201353.893893:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8e00 x1875064681300992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201353.893905:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681299968:0@lo:400:kworker.0 00000100:00080000:1.0:1788201353.893917:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201353.893920:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9cdf8263f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201353.893923:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201353.893926:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9cdf8263f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201353.893928:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 246 00000100:00080000:1.0:1788201353.893932:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf8263f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201353.893943:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8380 x1875064681301120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201353.893952:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681300480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.894352:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681300864:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788201353.894417:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.894482:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681300992:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788201353.894515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.894550:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681301120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788201353.894587:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.894649:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681300864 00000100:00100000:0.0:1788201353.894656:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681300864 00000100:00100000:0.0:1788201353.894711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681300992 00000100:00100000:0.0:1788201353.894715:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681300992 00000100:00100000:0.0:1788201353.894783:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681301120 00000100:00100000:0.0:1788201353.894787:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681301120 00000100:00100000:0.0:1788201353.894811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788201353.894819:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681300864:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788201353.894839:0:6517:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201353.894889:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681300864:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 70us (472us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201353.894897:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788201353.894912:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788201353.894915:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681300992:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788201353.894925:0:6517:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201353.894948:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681300992:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31us (434us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201353.894954:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788201353.894964:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788201353.894967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681301120:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788201353.894976:0:6517:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201353.894998:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681301120:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 29us (414us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201353.895003:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788201353.895054:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0aafdc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201353.895059:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201353.895063:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681300864:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788201353.895070:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1fc5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201353.895073:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201353.895076:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681300992:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788201353.895098:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf8263f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201353.895101:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201353.895104:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681301120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788201354.360576:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201354.360604:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681301248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201354.360700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201354.360801:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681301248 00000100:00100000:3.0:1788201354.360811:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681301248 00000100:00100000:3.0:1788201354.361021:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201354.361031:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681301248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201354.361070:0:8433:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201354.361192:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681301248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201354.361200:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201354.361257:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681301248:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201354.421873:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201355.446896:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201356.410878:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681301376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201356.410970:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201356.411205:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681301376 00000100:00100000:0.0:1788201356.411215:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681301376 00000100:00100000:0.0:1788201356.411297:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788201356.411355:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681301376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201356.411394:0:8434:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788201356.411455:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681301376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201356.411463:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788201356.411516:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681301376:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201356.411734:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201356.480206:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201357.088093:0:15453:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788201357.115628:0:15453:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788201357.115714:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.115733:0:15453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.115758:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.115765:0:15453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.115794:0:15453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201357.115800:0:15453:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788201357.115834:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201357.115840:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788201357.115847:0:15453:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201357.115854:0:15453:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1fc5000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788201357.115860:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201357.115862:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788201357.115866:0:15453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201357.116643:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201357.116656:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201357.116818:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201357.116824:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201357.116835:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201357.116842:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201357.116848:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201357.116850:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201357.116853:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788201357.116918:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201357.116926:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201357.116963:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201357.116971:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee447202bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201357.116990:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201357.117010:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201357.117012:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201357.117041:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681301504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201357.117250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201357.117348:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681301504 00000100:00100000:2.0:1788201357.117357:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681301504 00000100:00100000:2.0:1788201357.117404:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201357.117412:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aafd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1875064681301504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788201357.117419:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201357 with bad export cookie 17993880446834965884 00010000:00010000:1.0:1788201357.124289:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124325:0:15453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124334:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124361:0:15453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124382:0:15453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201357.124390:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124398:0:15453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124405:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124411:0:15453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124431:0:15453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201357.124449:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201357.124456:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124464:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75e00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201357.124469:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124480:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201357.124488:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201357.124502:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201357.124505:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1788201357.124549:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124557:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201357.124588:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124607:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee447202ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee447202d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124624:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201357.124628:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124634:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce081671800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201357.124637:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124644:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201357.124650:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201357.124657:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201357.124659:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788201357.124661:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788201357.124683:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124690:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201357.124696:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124703:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce081671800/0xf9b71aee44720196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472019d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201357.124718:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201357.124720:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201357.124722:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201357.124770:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681301632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201357.124861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201357.124924:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201357.124930:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681301760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201357.124952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201357.124988:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681301632 00000100:00100000:1.0:1788201357.124997:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681301632 00000100:00100000:1.0:1788201357.125032:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681301760 00000100:00100000:1.0:1788201357.125035:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681301760 00000100:00100000:1.0:1788201357.125049:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201357.125057:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875064681301632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788201357.125064:0:8446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201357 with bad export cookie 17993880446834965884 00000100:00100000:1.0:1788201357.125112:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875064681301632:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (251us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201357.125120:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201357.125138:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201357.125142:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875064681301760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788201357.125154:0:8446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201357 with bad export cookie 17993880446834965884 00000100:00100000:1.0:1788201357.125181:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875064681301760:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (227us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201357.125187:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788201357.125226:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201357.125231:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ce0a0861800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788201357.125236:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788201357.125317:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201357.125355:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125365:0:15453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125373:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125380:0:15453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125396:0:15453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201357.125402:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125410:0:15453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125425:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125431:0:15453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125444:0:15453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788201357.125449:0:15453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788201357.125454:0:15453:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788201357.125491:0:15453:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788201357.125496:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788201357.125501:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201357.125507:0:15453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788201357.125513:0:15453:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9cdf82639800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201357.125519:0:15453:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9cdf821da800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201357.125525:0:15453:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9ce0a6580000) has exports, disconnecting them 00000020:00080000:0.0:1788201357.125530:0:15453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9cdf82639800), last request at 1788201353 00000020:00000080:0.0:1788201357.125539:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472015e 00000100:00080000:0.0:1788201357.125557:0:15453:0:(import.c:65:import_set_state_nolock()) ffff9cdf82638000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201357.125613:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201357.125619:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125627:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080030a00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201357.125631:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.125638:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201357.125653:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201357.125659:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201357.125661:0:7466:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788201357.125662:0:7466:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788201357.128829:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201357.128845:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201357.128860:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201357.128882:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201357.128894:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201357.128902:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201357.128909:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201357.128911:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788201357.128915:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1788201357.134446:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aafd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1875064681301504:12345-0@lo:103:ldlm_bl.0 Request processed in 17024us (17187us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201357.134463:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788201357.134692:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201357.154729:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.102@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788201357.154758:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788201357.154773:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf825ff800 x1875064681299712/t0(0) o400->MGC192.168.203.102@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201357.154791:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf837a5880 x1875064681301504/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201373 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201357.154802:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a9880 x1875064681301632/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201373 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201357.154810:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a8000 x1875064681301760/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201373 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788201357.154820:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788201357.154823:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788201357.154824:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1788201357.155499:0:7466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.155512:0:7466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201357.155555:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.155563:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce080030a00/0xf9b71aee44720532 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44720539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.155772:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201357.155775:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201357.155778:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201357.155850:0:15453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf82639800): rc 0 00000020:00000080:0.0:1788201357.155853:0:15453:0:(genops.c:906:class_export_put()) final put ffff9cdf82639800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788201357.155866:0:15453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9cdf821da800), last request at 1788201353 00000020:00000080:0.0:1788201357.155875:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720038 00000100:00080000:0.0:1788201357.155891:0:15453:0:(import.c:65:import_set_state_nolock()) ffff9cdf821db800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201357.155914:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201357.155922:0:15453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf821da800): rc 0 00000020:00000080:0.0:1788201357.155924:0:15453:0:(genops.c:906:class_export_put()) final put ffff9cdf821da800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788201357.155934:0:15453:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffc151814bbae0 00000100:00080000:0.0:1788201357.155960:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201357.155986:0:15453:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9ce0b94c4e00 x1875064681299328/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201366 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201357.155996:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788201357.157264:0:15453:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201357.157274:0:15453:0:(import.c:65:import_set_state_nolock()) ffff9ce0c1dcd800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1788201357.157363:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf82639800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788201357.157427:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821da800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788201357.157519:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf82638000 for lustre-MDT0001 00000020:00000080:0.0:1788201357.157525:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf821db800 for lustre-MDT0001 00010000:00010000:0.0:1788201357.157538:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201357.157992:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201357.158005:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201357.158025:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201357.158032:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74200/0xf9b71aee4471fe7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4471fe86 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201357.158052:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201357.158054:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201357.158055:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201357.158189:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ce0a0861800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788201357.158239:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49adc14-d6d0-415b-83c4-8895eee6f8a8:0:1875064681301888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201357.158251:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681299328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201357.158286:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:0:1875064681302016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201357.158293:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3645:1875064681301504:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788201357.158782:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201357.158788:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1788201357.158808:0:15453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788201357.158874:0:15453:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788201357.158896:0:15453:0:(import.c:65:import_set_state_nolock()) ffff9cdf821db000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788201357.158912:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201357.158915:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788201357.158927:0:15453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201357.159002:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681302144:0@lo:9:umount.0 00000100:00100000:0.0:1788201357.159090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201357.159160:0:15453:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788201357.159171:0:15453:0:(import.c:65:import_set_state_nolock()) ffff9cdf83355800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201357.159189:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681302272:0@lo:9:umount.0 00000100:00100000:0.0:1788201357.159216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788201357.159268:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9ce0a6580000) has no exports 00000100:00100000:0.0:1788201357.159366:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681302144 00000100:00100000:0.0:1788201357.159375:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681302144 00000100:00100000:0.0:1788201357.159448:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681302272 00000100:00100000:0.0:1788201357.159452:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681302272 00000100:00100000:0.0:1788201357.159490:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201357.159500:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875064681302144:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201357.159530:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720085 00000100:00080000:0.0:1788201357.159540:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9cdf82085800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201357.159586:0:8430:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1788201357.159800:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3643:x1875064681302144:12345-0@lo:9:umount.0 Request processed in 300us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201357.159809:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201357.159825:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201357.159832:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875064681302272:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201357.159845:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447201c7 00000100:00080000:0.0:1788201357.159851:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf45b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201357.159879:0:8430:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788201357.159958:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3643:x1875064681302272:12345-0@lo:9:umount.0 Request processed in 126us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201357.159965:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:0.0:1788201357.159991:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201357.160024:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf83355800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201357.160030:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201357.160032:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201357.160035:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681302272:0@lo:9:umount.0 00000100:00080000:0.0:1788201357.160047:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821db000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201357.160050:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201357.160051:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201357.160053:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681302144:0@lo:9:umount.0 00010000:00010000:0.0:1788201357.160075:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201357.160218:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201357.164144:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ce0a0861800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201357.164164:0:3646:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 181 00000100:00080000:1.0:1788201357.164176:0:3646:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff9ce0a0861800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201357.164248:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6ab800 x1875064681302400/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201357.164315:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3643:1875064681302400:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788201357.164385:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064681302400 offset 0 length 520: 4 00000100:00100000:1.0:1788201357.164518:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681301632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201357.164529:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf825ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681299712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201357.164578:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3646:1875064681301760:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788201357.170212:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9ce0a6580000) has no exports 00000020:01000000:1.0:1788201357.276237:0:15453:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf82560e40 - data ffff9ce0abf36bd0/ffff9cdf83451c00 00000020:01000000:1.0:1788201357.276406:0:15453:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ce0ba1afd80 - data ffff9ce0abd62ca8/ffff9ce0ba1ce400 00000001:00000004:0.0:1788201357.298007:0:15453:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1788201357.360828:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201357.360836:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788201357.360845:0:15453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788201357.363769:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201357.363777:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1788201357.363796:0:15453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201357.363798:0:15453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201357.364382:0:8474:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201357.364399:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788201357.364409:0:8474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788201357.365839:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201357.365845:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1788201357.365865:0:15453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201357.365867:0:15453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201357.366628:0:9971:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201357.366633:0:9971:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788201357.366654:0:9971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788201357.369010:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fea2 00000020:00000080:1.0:1788201357.369033:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce09e1de800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788201357.370632:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e1de800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788201357.373219:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471feb7 00000020:00000080:1.0:1788201357.373234:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b9684000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788201357.373289:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788201357.373294:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201357.373303:0:15453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201357.373307:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9ce0a65819c0) has no exports 00000004:01000000:1.0:1788201357.373508:0:15453:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201357.373517:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447201c0 00000020:00000080:1.0:1788201357.373521:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0bf458000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201357.374307:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9684000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788201357.374546:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf458000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788201357.374615:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788201357.374684:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201357.374696:0:15453:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201357.374699:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9ce0c15019c0) has no exports 00000020:00000080:0.0:1788201357.374708:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447201b9 00000020:00000080:0.0:1788201357.374713:0:15453:0:(genops.c:906:class_export_put()) final put ffff9cdf83351800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788201357.375298:0:15453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788201357.375302:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201357.375307:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788201357.375313:0:15453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201357.375315:0:15453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201357.375899:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf83351800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788201357.376006:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201357.376015:0:15453:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201357.376031:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472007e 00000020:00000080:0.0:1788201357.376038:0:15453:0:(genops.c:906:class_export_put()) final put ffff9cdf82083000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201357.376556:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf83355800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788201357.376563:0:493:0:(genops.c:906:class_export_put()) final put ffff9cdf8263e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201357.376566:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8263e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788201357.376572:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788201357.376926:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788201357.376933:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201357.376941:0:15453:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201357.376951:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9cdf821d19c0) has no exports 00000020:00000080:3.0:1788201357.377148:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf82083000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788201357.377177:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720077 00000020:00000080:0.0:1788201357.377183:0:15453:0:(genops.c:906:class_export_put()) final put ffff9cdf821d9800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788201357.377813:0:15453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788201357.377818:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201357.377822:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1788201357.377828:0:15453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201357.377830:0:15453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201357.379865:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821d9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788201357.383924:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201357.383945:0:15453:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788201357.384147:0:15453:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788201357.384157:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471feda 00000020:00000080:0.0:1788201357.384165:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b3156800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201357.384755:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf821db000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788201357.384764:0:493:0:(genops.c:906:class_export_put()) final put ffff9cdf821dc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201357.384767:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821dc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788201357.384776:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788201357.385205:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788201357.385228:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201357.385237:0:15453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201357.385242:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9ce0a6583380) has no exports 00000020:00000080:0.0:1788201357.385250:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fed3 00000020:00000080:0.0:1788201357.385256:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0c1dc9800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788201357.385683:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3156800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788201357.387640:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0c1dc9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788201357.387795:0:15453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788201357.387799:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201357.387803:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788201357.387810:0:15453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201357.387862:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201357.387874:0:15453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201357.387909:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201357.387913:0:15453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201357.387918:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b3153000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788201357.387921:0:15453:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3153000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788201357.387930:0:15453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201357.388117:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471febe 00000020:00000080:1.0:1788201357.388123:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b9683000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788201357.388127:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788201357.388131:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201357.388134:0:15453:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201357.388138:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9ce0c1503380) has no exports 00000020:00000080:1.0:1788201357.388157:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201357.388160:0:15453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788201357.388163:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fec5 00000020:00000080:1.0:1788201357.388166:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b9686000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788201357.388173:0:15453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce09e1da800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788201357.388176:0:15453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce09e1da800 2 00000020:01000004:1.0:1788201357.388178:0:15453:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce09e1da800 from lustre-MDT0001 00000020:00000080:1.0:1788201357.388193:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201357.388195:0:15453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788201357.388198:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b3152000/lustre-MDT0001_UUID 00000020:00000080:1.0:1788201357.388199:0:15453:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3152000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788201357.388205:0:15453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788201357.388231:0:15453:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788201357.388235:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788201357.388237:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201357.388240:0:15453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201357.388246:0:15453:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ce09e18f000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201357.388251:0:15453:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9ce0b9704d40) has exports, disconnecting them 00000020:00080000:1.0:1788201357.388262:0:15453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ce09e18f000), last request at 1788201120 00000020:00000080:1.0:1788201357.388265:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471ff19 00000020:00080000:1.0:1788201357.388278:0:15453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce09e18f000): rc 0 00000020:00000080:1.0:1788201357.388282:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce09e18f000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788201357.389864:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0c1dcd800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788201357.389878:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0b3157000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201357.389881:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3157000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788201357.389887:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201357.390027:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9683000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788201357.390032:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0b9684800/lustre-MDD0001_UUID 00000020:00000080:3.0:1788201357.390034:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9684800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788201357.390038:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788201357.390409:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9686000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201357.390415:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e18f000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788201357.428809:0:15453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788201357.428817:0:15453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201357.428822:0:15453:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201357.428829:0:15453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201357.429027:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0c1fc5000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788201357.429157:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201357.429165:0:15453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788201357.429170:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b3151000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788201357.429174:0:15453:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3151000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788201357.429185:0:15453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788201357.429255:0:15453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce09e1da800 1 00000020:00000080:0.0:1788201357.429261:0:15453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fe55 00000020:00000080:0.0:1788201357.429266:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b3153800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788201357.429314:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788201357.429318:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201357.429323:0:15453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201357.429326:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9ce0b9703380) has no exports 00000020:00000080:3.0:1788201357.432846:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3153800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:3.0:1788201357.547139:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201357.554325:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201357.554341:0:15453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788201357.554346:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce09e1db000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788201357.554351:0:15453:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce09e1db000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788201357.554363:0:15453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788201357.558636:0:15453:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce09e1df800 00000020:01000000:1.0:1788201357.558666:0:15453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788201357.558676:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201357.558681:0:15453:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201357.558686:0:15453:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9ce0a64399c0) has no exports 00000100:00100000:2.0:1788201357.562608:0:8476:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9cdf81948a00:8476] 3 exiting: rc = 0 00000100:00100000:2.0:1788201357.562730:0:10723:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9ce0ba38c000:10723] 4 exiting: rc = 0 00000100:00100000:2.0:1788201357.562838:0:6515:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ce0a6435200:6515] 0 exiting: rc = 1 00000100:00100000:1.0:1788201357.563324:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ce0a6435600:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1788201357.566402:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ce0b5adc400:6517] 2 exiting: rc = 0 00000100:00100000:2.0:1788201357.566608:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566627:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566633:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566639:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566645:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566662:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566667:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566673:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566678:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566699:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566705:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566711:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566718:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566723:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566729:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566735:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566759:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566765:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566770:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566776:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566783:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566789:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566794:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566800:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566805:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566812:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566818:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566824:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566831:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566836:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566841:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566847:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566853:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566859:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566864:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566869:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566875:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566881:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566886:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566891:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566905:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566910:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566916:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566921:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566927:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566933:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566940:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566945:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566951:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566968:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566975:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566980:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566985:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566991:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.566996:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567001:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567007:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567013:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567018:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567024:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567031:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567036:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567042:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.567048:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.569426:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ce0b5adca00:6518] 0 exiting: rc = 1 00000100:00100000:3.0:1788201357.570000:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ce0b5adc000:6519] 1 exiting: rc = 0 00000100:00100000:1.0:1788201357.570405:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570415:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570421:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570428:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570434:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570440:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570446:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570453:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570459:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570465:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570471:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570477:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570482:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570488:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570494:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570499:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570505:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570510:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570532:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570537:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570542:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570547:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570552:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570557:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570562:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570567:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570572:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570576:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570581:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570586:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570603:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570608:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570613:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570626:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570632:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570637:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570642:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570648:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570654:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570659:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570664:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570668:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570673:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570678:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570682:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570687:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570692:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570696:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570701:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570705:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570710:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570714:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570719:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570732:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570764:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570770:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570775:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570780:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570785:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570790:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570795:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570800:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570805:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.570809:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.571228:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ce0b5adce00:6520] 0 exiting: rc = 1 00000100:00100000:3.0:1788201357.572089:0:9551:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9cdf82628200:9551] 2 exiting: rc = 0 00000100:00100000:3.0:1788201357.572179:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ce0b5adc800:6521] 1 exiting: rc = 0 00000100:00100000:1.0:1788201357.574223:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574232:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574242:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574248:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574254:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574260:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574267:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574273:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574279:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574285:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574311:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574320:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574326:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574332:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574338:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574344:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574350:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574355:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574364:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574370:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574375:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574382:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574404:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574426:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574432:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574439:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574445:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574451:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574457:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574464:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574469:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574475:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574491:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574497:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574520:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574527:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574532:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574538:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574544:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574549:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574555:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574560:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574568:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574575:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574581:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574598:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574629:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574638:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574645:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574652:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574660:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574666:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574672:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574679:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574684:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574690:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574696:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574703:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574732:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574767:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574774:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574780:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574786:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.574793:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592197:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ce085ed1400:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1788201357.592363:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ce085ed1a00:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1788201357.592465:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592472:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592478:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592483:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592489:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592495:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592500:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592505:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592510:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592514:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592519:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592524:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592529:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592535:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592540:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592545:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592550:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592555:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592561:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592566:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592571:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592576:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592580:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592585:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592601:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592606:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592611:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592615:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592633:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592637:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592642:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592646:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592650:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592655:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592660:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592665:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592669:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592674:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592678:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592683:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592687:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592691:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592696:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592701:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592706:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592711:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592716:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592721:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592726:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592732:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592769:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592775:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592779:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592784:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592788:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592793:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592798:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592802:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592807:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592811:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592816:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592821:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592826:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.592840:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.593275:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ce0889b0000:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1788201357.593390:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ce0b3418e00:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1788201357.593615:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593621:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593627:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593642:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593647:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593652:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593657:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593661:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593666:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593670:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593675:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593680:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593685:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593690:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593695:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593700:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593705:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593710:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593715:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593720:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593725:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593730:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.593734:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594030:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594036:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594041:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594046:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594051:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594056:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594061:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594066:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594078:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594084:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594089:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594107:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594112:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594117:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594122:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594127:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594132:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594138:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594142:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594147:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594152:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594158:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594163:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594167:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594172:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594177:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594182:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594187:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594192:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594196:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594201:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594206:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594211:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594215:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594220:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594224:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594229:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594233:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594238:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594243:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.594248:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201357.599894:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ce0a5dc0600:6527] 1 exiting: rc = 0 00000100:00100000:3.0:1788201357.600062:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ce0b3419000:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1788201357.600205:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600212:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600217:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600222:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600228:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600241:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600246:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600251:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600257:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600262:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600267:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600272:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600277:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600282:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600287:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600293:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600297:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600301:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600306:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600311:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600315:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600320:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600325:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600330:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600336:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600341:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600346:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600351:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600356:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600361:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600366:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600371:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600376:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600381:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600386:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600391:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600396:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600401:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600407:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600413:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600426:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600432:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600437:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600441:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600447:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600451:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600456:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600461:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600465:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600470:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600475:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600480:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600485:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600491:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600495:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600500:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600505:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600509:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600513:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600518:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600522:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600528:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600532:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.600537:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201357.601108:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ce0a5dc1800:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1788201357.601264:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ce0b3419200:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1788201357.601420:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ce0a5dc0c00:6530] 2 exiting: rc = 0 00000100:00100000:1.0:1788201357.601525:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601533:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601538:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601544:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601550:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601556:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601561:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601583:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601617:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601623:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601629:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601646:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601651:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601656:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601662:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601668:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601675:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601681:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601686:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601691:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601695:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601699:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601705:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601710:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601715:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601721:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601725:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601730:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601735:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601772:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601778:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601798:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601805:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601810:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601815:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601821:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601826:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601831:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601837:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601842:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601847:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601852:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601858:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601863:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601868:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601874:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601887:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601893:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601898:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601903:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601908:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601912:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601918:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601924:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601929:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601949:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601957:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601962:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601968:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601973:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601978:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601983:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601989:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201357.601994:0:15453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788201357.609673:0:15453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201357.609686:0:15453:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788201357.609692:0:15453:0:(genops.c:906:class_export_put()) final put ffff9ce0b30ba000/MDS_uuid 00000020:00000080:1.0:1788201357.609696:0:15453:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b30ba000/MDS_uuid for MDS 00000020:01000000:1.0:1788201357.609702:0:15453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788201357.609853:0:15453:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788201358.583654:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201358.979000:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201358.979010:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201358.979014:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201358.979017:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201358.979021:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0aafdc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201358.979030:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 434 00000100:00080000:1.0:1788201358.979037:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201358.979044:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ce0aafdc800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201358.979089:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8000 x1875064681302528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201358.979142:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201358.979146:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201358.979148:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cdf8263f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201358.979152:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 434 00000100:00080000:1.0:1788201358.979155:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201358.979158:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf8263f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201358.979170:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a9c00 x1875064681302784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201358.979202:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681302912:0@lo:400:kworker.0 00000400:00000100:1.0:1788201358.979253:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681302912 offset 0 length 224: 4 00000100:00100000:1.0:1788201358.979308:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201358.979314:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681302656:0@lo:400:kworker.0 00000400:00000100:1.0:1788201358.979331:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681302656 offset 0 length 224: 4 00000100:00100000:2.0:1788201358.979425:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681302528:0@lo:38:kworker.0 00000400:00000100:2.0:1788201358.979449:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681302528 offset 0 length 520: 4 00000100:00100000:2.0:1788201358.979462:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681302784:0@lo:38:kworker.0 00000400:00000100:2.0:1788201358.979477:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681302784 offset 0 length 520: 4 00010000:00010000:0.0:1788201359.608008:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201360.630246:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201361.374124:0:15654:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788201361.392937:0:15654:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788201361.392990:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.393005:0:15654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.393013:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.393020:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.393041:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201361.393046:0:15654:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788201361.393072:0:15654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201361.393084:0:15654:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a8000 x1875064681302528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201373 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201361.393097:0:15654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201361.393103:0:15654:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201361.393109:0:15654:0:(import.c:65:import_set_state_nolock()) ffff9ce0aafdc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788201361.393113:0:15654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201361.393117:0:15654:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a8000 x1875064681302528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201373 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201361.393124:0:15654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201361.393126:0:15654:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:2.0:1788201361.393194:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201361.393201:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.393209:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74600 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201361.393212:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.393221:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201361.393228:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201361.393234:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201361.393236:0:7466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201361.393238:0:7466:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788201361.393251:0:7466:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce0a0861800 00010000:00010000:2.0:1788201361.393254:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.393260:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74600/0xf9b71aee447202a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447202a7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.393271:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201361.393273:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201361.393274:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201361.393303:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681302528:0@lo:38:kworker.0 00000100:00080000:3.0:1788201361.394204:0:15654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201361.394215:0:15654:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a9880 x1875064681302656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201361.394238:0:15654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201361.394242:0:15654:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788201361.394262:0:15654:0:(import.c:65:import_set_state_nolock()) ffff9cdf821de000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201361.394443:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681302656:0@lo:400:kworker.0 00000100:00100000:2.0:1788201361.394471:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681303040:0@lo:39:umount.0 00000400:00000100:2.0:1788201361.394524:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681303040 offset 0 length 224: 4 00010000:00010000:0.0:1788201361.653966:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201362.037995:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201362.038004:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201362.038007:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201362.038010:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201362.038144:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681303168:0@lo:400:kworker.0 00000400:00000100:2.0:1788201362.038198:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681303168 offset 0 length 224: 4 00000001:00100000:1.0:1788201362.552223:0:8425:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788201362.552233:0:8425:0:(genops.c:906:class_export_put()) final put ffff9cdf82086000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201362.552308:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf82086000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201362.552454:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf82085800 for lustre-OST0000 00000001:00100000:0.0:1788201362.553652:0:9511:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201362.553659:0:9511:0:(genops.c:906:class_export_put()) final put ffff9ce0bf45f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201362.554494:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf45f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788201362.554566:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf45b800 for lustre-OST0001 00010000:00010000:0.0:1788201362.679321:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201363.701918:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201364.088980:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201364.088990:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201364.088993:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201364.088996:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201364.089124:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201364.089146:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681303296:0@lo:400:kworker.0 00000400:00000100:3.0:1788201364.089211:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681303296 offset 0 length 224: 4 00010000:00010000:0.0:1788201364.726005:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201365.750781:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201366.773981:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201367.542712:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201357/real 1788201357] req@ffff9ce0bf6ab800 x1875064681302400/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201367 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201367.542772:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf6ab800 x1875064681302400/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201367 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201367.542814:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a0861800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201367.542846:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788201367.542851:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3643:1875064681302400:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788201367.543126:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201367.543133:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201367.543136:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0a0861800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201367.543142:0:493:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1788201367.543148:0:493:0:(import.c:589:import_select_connection()) MGC192.168.203.102@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201367.543157:0:493:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff9ce0a0861800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201367.543198:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf4e8e00 x1875064681303424/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201367.543228:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201367.543249:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201367.543334:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681303552:0@lo:400:kworker.0 00000400:00000100:3.0:1788201367.543402:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681303552 offset 0 length 224: 4 00000100:00100000:2.0:1788201367.543514:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3643:1875064681303424:0@lo:250:kworker.0 00000400:00000100:2.0:1788201367.543548:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064681303424 offset 0 length 520: 4 00010000:00010000:0.0:1788201367.798292:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201368.822317:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201369.846305:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.870039:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201371.637918:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201361/real 1788201361] req@ffff9cdf8410fb80 x1875064681303040/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201371 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201371.637952:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cdf8410fb80 x1875064681303040/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201371 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201371.637971:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821de000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201371.638008:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681303040:0@lo:39:umount.0 00000100:00080000:3.0:1788201371.638087:0:15654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201371.638092:0:15654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201371.638097:0:15654:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788201371.639279:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201371.639295:0:15654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201371.639303:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201371.639324:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201371.639697:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201371.639707:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201371.639715:0:15654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201371.640808:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201371.640823:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201371.651185:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201371.651200:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201371.651213:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201371.651218:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201371.651228:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201371.651236:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201371.651242:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201371.651244:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788201371.651258:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce0a0861800 00010000:00010000:0.0:1788201371.651262:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201371.651268:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75800/0xf9b71aee447202ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447202b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201371.651288:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201371.651292:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201371.651319:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201371.651322:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201371.651329:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201371.651334:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201371.651339:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201371.651341:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788201371.651346:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce0a0861800 00010000:00010000:0.0:1788201371.651349:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201371.651356:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201371.651358:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201371.651360:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201371.652057:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201371.652066:0:15654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce080031000/0xf9b71aee44720524 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472052b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201371.652080:0:15654:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788201371.652086:0:15654:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788201371.652088:0:15654:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788201371.652130:0:15654:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788201371.652135:0:15654:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788201371.652142:0:15654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201371.652147:0:15654:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201371.652151:0:15654:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9ce0ba0fcd40) has no exports 00000020:00080000:3.0:1788201371.652177:0:15654:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9ce0ba0fcd40) has no exports 00000020:01000000:3.0:1788201371.660114:0:15654:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf81bb74e0 - data ffff9ce0abe91ca8/ffff9cdf83427400 00000020:01000000:3.0:1788201371.660344:0:15654:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf81bb72a0 - data ffff9ce0abe295e8/ffff9cdf82020000 00010000:00010000:2.0:1788201371.661113:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788201371.681294:0:15654:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788201371.699161:0:15654:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fff2 00000020:00000080:2.0:1788201371.699173:0:15654:0:(genops.c:906:class_export_put()) final put ffff9cdf819d4800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788201371.699194:0:15654:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0b95bd800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788201371.699199:0:15654:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0b95bd800 2 00000020:01000004:2.0:1788201371.699203:0:15654:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce0b95bd800 from lustre-OST0000 00000020:00000080:2.0:1788201371.699227:0:15654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201371.699237:0:15654:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788201371.699240:0:15654:0:(genops.c:906:class_export_put()) final put ffff9cdf819d6000/lustre-OST0000_UUID 00000020:00000080:2.0:1788201371.699243:0:15654:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf819d6000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788201371.699250:0:15654:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788201371.699310:0:15654:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788201371.699315:0:15654:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788201371.699319:0:15654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201371.699324:0:15654:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201371.699331:0:15654:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ce0c1dcc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201371.699338:0:15654:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9ce0b97019c0) has exports, disconnecting them 00000020:00080000:2.0:1788201371.699342:0:15654:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ce0c1dcc000), last request at 1788201140 00000020:00000080:2.0:1788201371.699347:0:15654:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472001c 00000020:00080000:2.0:1788201371.699376:0:15654:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0c1dcc000): rc 0 00000020:00000080:2.0:1788201371.699382:0:15654:0:(genops.c:906:class_export_put()) final put ffff9ce0c1dcc000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788201371.700682:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf819d4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788201371.700700:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0c1dcc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788201371.701964:0:15654:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788201371.701971:0:15654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201371.701975:0:15654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201371.701982:0:15654:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201371.702020:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0aafdc800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788201371.702170:0:15654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201371.702179:0:15654:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788201371.702184:0:15654:0:(genops.c:906:class_export_put()) final put ffff9ce0b3155000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788201371.702187:0:15654:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3155000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788201371.702193:0:15654:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788201371.702259:0:15654:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788201371.702263:0:15654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201371.702268:0:15654:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201371.702274:0:15654:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9cdf821df000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201371.702280:0:15654:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9cdf821d4d40) has exports, disconnecting them 00000020:00080000:1.0:1788201371.702284:0:15654:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9cdf821df000), last request at 1788201140 00000020:00000080:1.0:1788201371.702288:0:15654:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720031 00000020:00080000:1.0:1788201371.702301:0:15654:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf821df000): rc 0 00000020:00000080:1.0:1788201371.702306:0:15654:0:(genops.c:906:class_export_put()) final put ffff9cdf821df000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788201371.703056:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821df000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788201371.706853:0:15654:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788201371.706862:0:15654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201371.706866:0:15654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201371.706873:0:15654:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201371.706904:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf821de000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788201371.707057:0:15654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201371.707067:0:15654:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788201371.707071:0:15654:0:(genops.c:906:class_export_put()) final put ffff9ce0c1dc8800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788201371.707075:0:15654:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0c1dc8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788201371.707081:0:15654:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788201371.707145:0:15654:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0b95bd800 1 00000020:00000080:3.0:1788201371.707150:0:15654:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471ffba 00000020:00000080:3.0:1788201371.707157:0:15654:0:(genops.c:906:class_export_put()) final put ffff9ce0b6c05000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788201371.707165:0:15654:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788201371.707172:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b6c05000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788201371.707181:0:15654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201371.707186:0:15654:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201371.707190:0:15654:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9ce0ba0f8000) has no exports 00000020:00000080:3.0:1788201371.763093:0:15654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201371.763106:0:15654:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788201371.763112:0:15654:0:(genops.c:906:class_export_put()) final put ffff9ce0b6c07800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788201371.763127:0:15654:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b6c07800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788201371.763138:0:15654:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788201371.763253:0:15654:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce0ba06e800 00000020:02000400:3.0:1788201371.763297:0:15654:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788201371.897440:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201372.790830:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201372.790838:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201372.790840:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201372.790843:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201372.790918:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201372.793451:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681303680:0@lo:400:kworker.0 00000400:00000100:0.0:1788201372.793521:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681303680 offset 0 length 224: 4 00010000:00010000:0.0:1788201372.918517:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201373.751085:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201358/real 1788201358] req@ffff9ce0bf6a9c00 x1875064681302784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201373 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201373.751113:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf6a9c00 x1875064681302784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201373 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201373.751143:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf8263f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201373.751157:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201373.751176:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681302784:0@lo:38:kworker.0 00000100:00080000:1.0:1788201373.751382:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201373.751387:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201373.751390:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201373.751393:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201373.751396:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cdf8263f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201373.751401:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 439 00000100:00080000:1.0:1788201373.751406:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201373.751413:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf8263f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201373.751443:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8700 x1875064681303808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201373.751534:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681303936:0@lo:400:kworker.0 00000400:00000100:3.0:1788201373.751587:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681303936 offset 0 length 224: 4 00000100:00100000:2.0:1788201373.751773:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681303808:0@lo:38:kworker.0 00000400:00000100:2.0:1788201373.751795:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681303808 offset 0 length 520: 4 00010000:00010000:2.0:1788201373.950863:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788201374.133896:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201358/real 1788201358] req@ffff9ce0bf6aaa00 x1875064681302912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201374.174908:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ce0bf6aaa00 x1875064681302912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201374.174923:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cdf831fa800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201374.174926:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201374.210689:0:3647:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788201374.210859:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201374.210866:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201374.210870:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201374.210874:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201374.210878:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cdf831fa800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201374.210888:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 246 00000100:00080000:1.0:1788201374.210907:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cdf831fa800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201374.210955:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a9f80 x1875064681304064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201374.210989:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681302912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.211017:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681304064:0@lo:38:kworker.0 00000400:00000100:1.0:1788201374.211180:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681304064 offset 0 length 520: 4 00010000:00010000:0.0:1788201374.966996:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201375.436716:0:15856:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788201375.466838:0:15856:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788201375.466927:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.466942:0:15856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.466950:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.466956:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.466979:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201375.466984:0:15856:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201375.467009:0:15856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201375.467021:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a8700 x1875064681303808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201393 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.467051:0:15856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201375.467057:0:15856:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201375.467063:0:15856:0:(import.c:65:import_set_state_nolock()) ffff9cdf8263f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788201375.467068:0:15856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201375.467085:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a8700 x1875064681303808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201393 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.467094:0:15856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201375.467098:0:15856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1788201375.467112:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681303808:0@lo:38:kworker.0 00010000:00010000:3.0:1788201375.468945:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201375.468957:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201375.468969:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254a00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201375.468973:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201375.468983:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201375.468991:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201375.468997:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201375.469000:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201375.469002:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201375.469019:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce0a0861800 00010000:00010000:3.0:1788201375.469023:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201375.469031:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83254a00/0xf9b71aee44720284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472028b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201375.469063:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201375.469065:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201375.469067:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201375.470122:0:15856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201375.470136:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf8410c380 x1875064681303168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201378 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.470159:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf4e8700 x1875064681303296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201380 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.470167:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf4e9f80 x1875064681303552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201383 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.470319:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a8a80 x1875064681303680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201388 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.470329:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6aad80 x1875064681303936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201389 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.470338:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a9f80 x1875064681304064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201384 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.470352:0:15856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201375.470358:0:15856:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788201375.470364:0:15856:0:(import.c:65:import_set_state_nolock()) ffff9cdf831fa800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788201375.470369:0:15856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201375.470373:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf8410c380 x1875064681303168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201378 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.470382:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf4e8700 x1875064681303296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201380 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.470390:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf4e9f80 x1875064681303552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201383 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201375.470487:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681303936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.476867:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681303552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.483926:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a8a80 x1875064681303680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201388 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.483941:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6aad80 x1875064681303936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201389 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.483951:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf6a9f80 x1875064681304064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201384 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.483961:0:15856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201375.484095:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681303296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201375.484107:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681303168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201375.488012:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681304064:0@lo:38:kworker.0 00000100:00100000:1.0:1788201375.492873:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681303680:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.494544:0:15856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201375.496295:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.496314:0:15856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.496322:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.496329:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.496415:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201375.496423:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.496430:0:15856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.496436:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201375.496456:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201375.498858:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201375.498870:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201375.498901:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201375.498906:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201375.498916:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201375.498924:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201375.498930:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201375.498933:0:7466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788201375.498945:0:7466:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce0a0861800 00010000:00010000:0.0:1788201375.498949:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201375.498957:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83254800/0xf9b71aee44720292 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee44720299 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201375.498974:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201375.498979:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201375.498984:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031e00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201375.498986:0:7466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201375.498992:0:7466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201375.499003:0:7466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201375.499008:0:7466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201375.499010:0:7466:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788201375.499015:0:7466:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce0a0861800 00010000:00010000:0.0:1788201375.499018:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201375.499025:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201375.499026:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201375.499029:0:7466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201375.500451:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201375.500472:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce080031e00/0xf9b71aee44720516 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472051d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201375.500494:0:15856:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788201375.500501:0:15856:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788201375.500503:0:15856:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788201375.500539:0:15856:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788201375.500543:0:15856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788201375.500550:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201375.500555:0:15856:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201375.500559:0:15856:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9cdf821d0000) has no exports 00000020:00080000:2.0:1788201375.500581:0:15856:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9cdf821d0000) has no exports 00010000:00010000:0.0:1788201375.504920:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788201375.506056:0:15856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf81aa91e0 - data ffff9ce0abea61b0/ffff9cdf83276000 00000020:01000000:2.0:1788201375.506899:0:15856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf81aa9d80 - data ffff9cdf81c67bd0/ffff9ce0b6d2c000 00100000:10000000:0.0:1788201375.523557:0:15856:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788201375.528647:0:15856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720118 00000020:00000080:1.0:1788201375.528665:0:15856:0:(genops.c:906:class_export_put()) final put ffff9cdf82639000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788201375.528692:0:15856:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cdf81977800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788201375.528698:0:15856:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cdf81977800 2 00000020:01000004:1.0:1788201375.528701:0:15856:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cdf81977800 from lustre-OST0001 00000020:00000080:3.0:1788201375.528767:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf82639000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788201375.528778:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201375.528793:0:15856:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788201375.528797:0:15856:0:(genops.c:906:class_export_put()) final put ffff9cdf8263b000/lustre-OST0001_UUID 00000020:00000080:1.0:1788201375.528801:0:15856:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8263b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788201375.528814:0:15856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788201375.529627:0:15856:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c49adc14-d6d0-415b-83c4-8895eee6f8a8->MGS 00010000:00010000:1.0:1788201375.529650:0:15856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74e00/0xf9b71aee4471fe71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4471fe78 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201375.529666:0:15856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74e00/0xf9b71aee4471fe71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4471fe78 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201375.529674:0:15856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788201375.529677:0:15856:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788201375.529681:0:15856:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788201375.529709:0:15856:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce0a0861800 00010000:00010000:1.0:1788201375.529713:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74e00/0xf9b71aee4471fe71 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4471fe78 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201375.529733:0:15856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447202fb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201375.529769:0:15856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447202fb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201375.529776:0:15856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201375.529779:0:15856:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788201375.529781:0:15856:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788201375.529792:0:15856:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce0a0861800 00010000:00010000:1.0:1788201375.529806:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a74c00/0xf9b71aee447202f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447202fb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201375.529827:0:15856:0:(import.c:65:import_set_state_nolock()) ffff9ce0a0861800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788201375.529832:0:15856:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788201375.529835:0:15856:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788201375.529837:0:15856:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788201375.529857:0:15856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788201375.529871:0:15856:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf4e8e00 x1875064681303424/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788201382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788201375.529898:0:15856:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788201375.529902:0:15856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1788201375.529961:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c49adc14-d6d0-415b-83c4-8895eee6f8a8:3643:1875064681303424:0@lo:250:kworker.0 10000000:01000000:1.0:1788201375.530386:0:15856:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788201375.530401:0:15856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4471fd6e 00000020:00000080:1.0:1788201375.530409:0:15856:0:(genops.c:906:class_export_put()) final put ffff9ce0b30bb800/c49adc14-d6d0-415b-83c4-8895eee6f8a8 00000020:01000000:1.0:1788201375.530430:0:15856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.102@tcp (flags='') 00000020:00000080:1.0:1788201375.530437:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201375.530443:0:15856:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201375.530447:0:15856:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9ce0b2520000) has no exports 00000020:00000080:3.0:1788201375.530513:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b30bb800/c49adc14-d6d0-415b-83c4-8895eee6f8a8 for MGC192.168.203.102@tcp 10000000:01000000:2.0:1788201375.530714:0:6513:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788201375.530880:0:15856:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.102@tcp: client import never connected 00000100:00080000:1.0:1788201375.530884:0:15856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788201375.530886:0:15856:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788201375.530889:0:15856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788201375.530891:0:15856:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788201375.530934:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201375.530940:0:15856:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.102@tcp (uuid c49adc14-d6d0-415b-83c4-8895eee6f8a8) 00000020:01000000:1.0:1788201375.530947:0:15856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788201375.530950:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201375.530953:0:15856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201375.530958:0:15856:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cdf8263c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201375.530964:0:15856:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9cdf821d3380) has exports, disconnecting them 00000020:00080000:1.0:1788201375.530968:0:15856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cdf8263c800), last request at 1788201165 00000020:00000080:1.0:1788201375.530983:0:15856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720142 00000020:00080000:1.0:1788201375.530995:0:15856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf8263c800): rc 0 00000020:00000080:1.0:1788201375.530999:0:15856:0:(genops.c:906:class_export_put()) final put ffff9cdf8263c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788201375.531275:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a0861800 for MGC192.168.203.102@tcp 00000020:00000080:3.0:1788201375.531281:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0a0860800/c49adc14-d6d0-415b-83c4-8895eee6f8a8 00000020:00000080:3.0:1788201375.531284:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a0860800/c49adc14-d6d0-415b-83c4-8895eee6f8a8 for MGC192.168.203.102@tcp 00000020:01000000:3.0:1788201375.531289:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.102@tcp (c49adc14-d6d0-415b-83c4-8895eee6f8a8) 00000020:00000080:3.0:1788201375.531522:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8263c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788201375.538811:0:15856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788201375.538820:0:15856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201375.538824:0:15856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201375.538832:0:15856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201375.538996:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201375.539005:0:15856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788201375.539012:0:15856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788201375.539017:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201375.539029:0:15856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201375.539036:0:15856:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9cdf8263d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201375.539042:0:15856:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9cdf831e8000) has exports, disconnecting them 00000020:00080000:2.0:1788201375.539047:0:15856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9cdf8263d800), last request at 1788201165 00000020:00000080:2.0:1788201375.539050:0:15856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44720157 00000020:00080000:2.0:1788201375.539066:0:15856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf8263d800): rc 0 00000020:00000080:2.0:1788201375.539071:0:15856:0:(genops.c:906:class_export_put()) final put ffff9cdf8263d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788201375.539273:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf8263f000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788201375.539279:0:493:0:(genops.c:906:class_export_put()) final put ffff9cdf8263c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788201375.539282:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8263c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788201375.539288:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788201375.539357:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8263d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788201375.557454:0:15856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788201375.557470:0:15856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201375.557474:0:15856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201375.557481:0:15856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201375.557517:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf831fa800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788201375.557567:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788201375.557680:0:7466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788201375.560787:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788201375.561246:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ce0aafe9800:6500] 1 exiting: rc = 0 00000100:00100000:2.0:1788201375.561413:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ce0834e0a00:6499] 0 exiting: rc = 1 00000100:00100000:3.0:1788201375.561513:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201375.563080:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ce0834e1c00:6501] 0 exiting: rc = 1 00000100:00100000:3.0:1788201375.563556:0:13184:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9cdf8363d400:13184] 4 exiting: rc = 0 00000100:00100000:0.0:1788201375.564183:0:8446:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9cdf81989a00:8446] 3 exiting: rc = 0 00000100:00100000:2.0:1788201375.564551:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ce091635c00:6503] 2 exiting: rc = 0 00000100:00100000:2.0:1788201375.564661:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ce0aafe8200:6502] 1 exiting: rc = 0 00000100:00100000:3.0:1788201375.565015:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565023:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565029:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565036:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565042:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565049:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565055:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565061:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565066:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565072:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565077:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565083:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565193:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565200:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565206:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565213:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565218:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565224:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565231:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565237:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565244:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565250:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565255:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565260:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565265:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565271:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565276:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565281:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565286:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565290:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565295:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565301:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565306:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565311:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565316:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565332:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565337:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565342:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565347:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565352:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565358:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565363:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565368:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565373:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565378:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565383:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565389:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565394:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565399:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565403:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565408:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565413:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565419:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565424:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565428:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565433:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565438:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565443:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565448:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565452:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565457:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565620:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565629:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.565634:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788201375.566668:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201375.566678:0:15856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788201375.566683:0:15856:0:(genops.c:906:class_export_put()) final put ffff9cdf82638800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788201375.566687:0:15856:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf82638800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788201375.566692:0:15856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788201375.566972:0:15856:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cdf81977800 1 00000020:00000080:3.0:1788201375.566979:0:15856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447200e7 00000020:00000080:3.0:1788201375.566985:0:15856:0:(genops.c:906:class_export_put()) final put ffff9ce0bf445800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788201375.567065:0:15856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788201375.567070:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201375.567075:0:15856:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201375.567079:0:15856:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff9ce0c1504d40) has no exports 00000020:00000080:1.0:1788201375.570666:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf445800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788201375.614771:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201375.614790:0:15856:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788201375.614797:0:15856:0:(genops.c:906:class_export_put()) final put ffff9cdf81972800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788201375.614803:0:15856:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf81972800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788201375.614811:0:15856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788201375.615594:0:15856:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cdf81977000 00000020:01000000:3.0:1788201375.615620:0:15856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788201375.615625:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201375.615630:0:15856:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201375.615635:0:15856:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9ce0ba0fb380) has no exports 00000020:00000080:3.0:1788201375.615671:0:15856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201375.615677:0:15856:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788201375.615680:0:15856:0:(genops.c:906:class_export_put()) final put ffff9ce0b6c05800/OSS_uuid 00000020:00000080:3.0:1788201375.615682:0:15856:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b6c05800/OSS_uuid for OSS 00000020:01000000:3.0:1788201375.615686:0:15856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788201375.615865:0:6512:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788201375.615872:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ce0b967b400:8432] 2 exiting: rc = 0 00000100:00100000:0.0:1788201375.616062:0:8485:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ce0ba2d6c00:8485] 3 exiting: rc = 0 00000100:00100000:0.0:1788201375.616149:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ce0c14c5800:8430] 0 exiting: rc = 1 00000100:00100000:1.0:1788201375.616455:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ce0c1d96000:8431] 1 exiting: rc = 0 00000100:00100000:3.0:1788201375.618027:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618039:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618050:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618063:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618071:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618076:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618082:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618087:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618093:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618108:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618114:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618120:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618141:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618146:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618152:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618156:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618161:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618166:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618172:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618178:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618184:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618190:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618196:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618202:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618207:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618213:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618218:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618223:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618229:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618234:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618239:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618244:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618249:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618255:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618261:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618266:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618271:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618276:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618282:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618287:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618293:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618299:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618304:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618309:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618315:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618320:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618326:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618339:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618344:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618349:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618355:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618359:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618365:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618371:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618376:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618381:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618385:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618391:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618396:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618400:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618405:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618410:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618416:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.618428:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.621618:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ce0ba0a1200:8433] 0 exiting: rc = 1 00000100:00100000:1.0:1788201375.621704:0:15165:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9cdf8363c800:15165] 2 exiting: rc = 0 00000100:00100000:0.0:1788201375.622035:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ce09e191600:8434] 1 exiting: rc = 0 00000100:00100000:3.0:1788201375.622188:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622196:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622202:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622207:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622213:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622218:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622223:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622228:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622232:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622238:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622243:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622248:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622260:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622268:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622273:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622278:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622283:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622288:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622307:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622313:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622317:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622322:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622327:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622332:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622337:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622341:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622345:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622351:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622355:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622360:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622364:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622369:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622375:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622380:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622385:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622390:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622395:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622400:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622404:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622409:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622415:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622421:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622426:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622432:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622437:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622443:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622448:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622452:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622457:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622473:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622480:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622485:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622490:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622502:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622508:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622513:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622518:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622528:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622534:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622540:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622545:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622550:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622555:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.622565:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.624718:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ce0b967fa00:8437] 2 exiting: rc = 0 00000100:00100000:0.0:1788201375.625419:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ce09e13d400:8435] 0 exiting: rc = 1 00000100:00100000:2.0:1788201375.625897:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ce08b3a0800:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1788201375.627247:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627314:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627323:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627329:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627336:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627354:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627362:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627368:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627374:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627380:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627387:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627394:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627400:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627405:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627412:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627418:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627443:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627450:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627456:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627473:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627480:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627487:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627494:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627500:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627506:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627513:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627521:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627526:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627532:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627553:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627561:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627568:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627574:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627581:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627587:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627593:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627599:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627605:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627611:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627618:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627623:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627629:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627635:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627642:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627648:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627654:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627661:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627666:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627672:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627677:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627683:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627696:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627701:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627707:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627713:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627719:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627725:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627840:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627856:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627863:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627869:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627875:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627880:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.627886:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201375.648540:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ce0b6d3b600:8438] 0 exiting: rc = 1 00000100:00100000:3.0:1788201375.648880:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ce0c1d97000:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1788201375.649050:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649061:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649067:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649293:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649302:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649504:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649514:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649519:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649525:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649530:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649796:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649810:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649815:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649820:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649828:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649837:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649844:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649849:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649855:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649860:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649865:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649870:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649895:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649900:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649906:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649911:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649916:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649920:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649927:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649936:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649940:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649946:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649951:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649956:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649962:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.649967:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650109:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650118:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650124:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650129:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650135:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650140:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650145:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650149:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650153:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650158:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650164:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650169:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650175:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650180:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650185:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650191:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650196:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650202:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650207:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650213:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650218:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650232:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650237:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650242:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650248:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650253:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650258:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201375.650263:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201375.663571:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ce0ba383400:8440] 0 exiting: rc = 1 00000100:00100000:2.0:1788201375.664814:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ce0ba383600:8441] 1 exiting: rc = 0 00000100:00100000:3.0:1788201375.665410:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665427:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665435:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665441:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665448:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665455:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665469:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665477:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665482:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665489:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665517:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665525:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665530:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665536:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665543:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665548:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665554:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665560:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665566:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665572:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665578:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665583:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665618:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665625:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665632:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665638:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665644:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665651:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665658:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665664:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665670:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665677:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665684:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665690:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665714:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665721:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665728:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665735:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665767:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665774:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665780:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665786:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665794:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665800:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665806:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665813:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665835:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665843:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665850:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665856:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665863:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665869:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665875:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665881:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665888:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665895:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665900:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665914:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665935:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665942:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.665948:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.666268:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.666276:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201375.666293:0:15856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788201375.682220:0:15856:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788201395.911221:0:16619:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788201406.070391:0:17219:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201406.070400:0:17219:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788201406.070402:0:17219:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788201406.070529:0:17219:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ce0ba1d3800 00000020:01000004:3.0:1788201406.070549:0:17219:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788201406.070559:0:17219:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788201406.070578:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ce0bf4519c0) 00000020:00000080:3.0:1788201406.070597:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788201406.232349:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201406.235840:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788201406.243355:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788201406.243607:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788201406.243820:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.244237:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.244643:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.244894:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.245154:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.245402:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.245591:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.245850:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.246024:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.246314:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.246537:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.246768:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.247004:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.251174:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.251914:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.252611:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.254653:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.255004:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.255270:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.256219:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.256477:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.257153:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.257390:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.257582:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.257956:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.260670:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.261027:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.261282:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.261488:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788201406.261672:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788201406.262225:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788201406.263065:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788201406.263517:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788201406.266459:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788201406.267223:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788201406.267522:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788201406.267811:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788201406.268059:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788201406.268321:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788201406.268524:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788201406.272690:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788201406.273366:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788201406.275835:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788201406.282581:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788201406.287321:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788201406.287593:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788201406.288330:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788201406.288574:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788201406.288811:0:17219:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788201406.289278:0:17219:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788201406.289517:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788201406.289525:0:17219:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201406.289536:0:17219:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee4472132b 00000020:01000004:1.0:1788201406.289543:0:17219:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788201406.289547:0:17219:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788201406.289552:0:17219:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0ba1d3800 from MGS 00000020:01000004:1.0:1788201406.289563:0:17219:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788201406.289573:0:17219:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cdf831eb380) 00000020:00000080:1.0:1788201406.289586:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788201406.289649:0:17219:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0ba1d3800 from MGS, refs=2 00080000:01000000:1.0:1788201406.289654:0:17219:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201406.289659:0:17219:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721339 00000100:00100000:1.0:1788201406.289975:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788201406.290149:0:17219:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788201406.290155:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788201406.292185:0:17219:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788201406.292197:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788201406.293466:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201406.294219:0:17219:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788201406.294226:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788201406.296657:0:17219:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788201406.296673:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788201406.297365:0:17219:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788201406.297373:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788201406.298555:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201406.298559:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201406.298561:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201406.298900:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201406.298902:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201406.298904:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201406.299430:0:17219:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1788201406.306452:0:17219:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:1.0:1788201406.306648:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788201406.308960:0:17231:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788201406.309022:0:17219:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788201406.309081:0:17219:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201406.310166:0:17219:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788201406.310891:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201406.311035:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788201406.311052:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788201406.311346:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788201406.311351:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788201406.314038:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788201406.314053:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788201406.314882:0:17236:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788201406.314978:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788201406.314999:0:17219:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.102@tcp' 00000020:01000004:2.0:1788201406.315001:0:17219:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788201406.315030:0:17219:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.102@tcp (typ=mgc) 00000020:00000080:2.0:1788201406.315121:0:17219:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.102@tcp (ffff9ce0b9700000) 00000020:00000080:2.0:1788201406.315137:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788201406.315212:0:17219:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf83774000@MGC192.168.203.102@tcp: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1788201406.315361:0:17219:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.102@tcp-0 is initialized 00000040:01000000:2.0:1788201406.315368:0:17219:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788201406.318261:0:17237:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788201406.318344:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.102@tcp (uuid b50ecc63-79e7-4d40-95c3-4efbcef0f7e7) 00000020:00000080:2.0:1788201406.318368:0:17219:0:(genops.c:1406:class_connect()) connect: client b50ecc63-79e7-4d40-95c3-4efbcef0f7e7, cookie 0xf9b71aee44721347 00000100:00080000:2.0:1788201406.318380:0:17219:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201406.318386:0:17219:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff9cdf83774000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201406.318418:0:17219:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf837a6a00 x1875064681304192/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201406.318446:0:17219:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS 00000020:01000004:2.0:1788201406.318459:0:17219:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788201406.318464:0:17219:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788201406.318477:0:17219:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ce0b97019c0) 00000020:00000080:2.0:1788201406.318487:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788201406.319168:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3643:1875064681304192:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788201406.319231:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201406.319399:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681304192 00000100:00100000:0.0:1788201406.319406:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681304192 00000100:00100000:0.0:1788201406.319432:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201406.319438:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875064681304192:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788201406.319467:0:17233:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from b50ecc63-79e7-4d40-95c3-4efbcef0f7e7@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1788201406.319491:0:17233:0:(genops.c:1406:class_connect()) connect: client b50ecc63-79e7-4d40-95c3-4efbcef0f7e7, cookie 0xf9b71aee44721355 00000100:00080000:0.0:1788201406.319591:0:17233:0:(import.c:65:import_set_state_nolock()) ffff9cdf8376f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201406.319648:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+5:3643:x1875064681304192:12345-0@lo:250:mount.lustre.0 Request processed in 209us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201406.319655:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201406.319692:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788201406.319699:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.102@tcp: connect to target with instance 0 00000100:00080000:0.0:1788201406.319705:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788201406.319708:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788201406.319711:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf83774000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788201406.319713:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788201406.319719:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788201406.319723:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3643:1875064681304192:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788201406.334288:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201406.334462:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201406.334469:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788201406.336989:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788201406.337000:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788201406.338197:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788201406.338206:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788201406.338907:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201406.339263:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788201406.339270:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788201406.350822:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788201406.350835:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788201406.429343:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201406.429528:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788201406.429534:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788201406.431158:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788201406.431170:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788201406.432283:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201406.432433:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788201406.432438:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788201406.432945:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788201406.432952:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788201406.433417:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201406.433534:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788201406.433538:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788201406.433953:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788201406.433960:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788201406.434699:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201406.434867:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788201406.434873:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788201406.435339:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788201406.435345:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788201406.476043:0:17219:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201406.476225:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201406.476231:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788201406.479213:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788201406.479230:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788201406.480231:0:17219:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201406.480242:0:17219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788201406.482827:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788201406.482862:0:17219:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788201406.482867:0:17219:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201406.482966:0:17219:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201406.482997:0:17219:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788201406.483002:0:17219:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201406.483004:0:17219:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201406.483005:0:17219:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201406.483006:0:17219:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201406.483007:0:17219:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201406.483009:0:17219:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201406.483011:0:17219:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201406.483012:0:17219:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201406.483014:0:17219:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201406.483015:0:17219:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201406.483018:0:17219:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788201406.483020:0:17219:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201406.483021:0:17219:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201406.483022:0:17219:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201406.483023:0:17219:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201406.483024:0:17219:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201406.483025:0:17219:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201406.483026:0:17219:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201406.483027:0:17219:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201406.483027:0:17219:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201406.483028:0:17219:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201406.483062:0:17219:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788201406.483081:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304320:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201406.483148:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.483235:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce087e1e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.483304:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681304320 00000100:00100000:2.0:1788201406.483311:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681304320 00000100:00100000:2.0:1788201406.483400:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201406.483410:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+5:17219:x1875064681304320:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201406.483457:0:17235:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201406.483460:0:17235:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201406.483463:0:17235:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788201406.483885:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788201406.485008:0:17235:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788201406.487274:0:17257:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788201406.487286:0:17257:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788201406.487289:0:17257:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788201406.487291:0:17257:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788201406.487507:0:17257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788201406.487784:0:17235:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201406.487796:0:17235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788201406.490307:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+5:17219:x1875064681304320:12345-0@lo:253:mount.lustre.0 Request processed in 6887us (7147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.490324:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201406.490382:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304320:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201406.490425:0:17219:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788201406.490429:0:17219:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201406.490431:0:17219:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201406.490432:0:17219:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201406.490434:0:17219:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201406.490435:0:17219:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201406.490437:0:17219:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201406.490439:0:17219:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201406.490440:0:17219:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201406.490443:0:17219:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201406.490445:0:17219:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201406.490471:0:17219:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0ba1d3800 from lustre-MDT0000 10000000:01000000:1.0:1788201406.490511:0:17219:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788201406.490515:0:17219:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201406.490520:0:17219:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ce0b9700000 10000000:01000000:1.0:1788201406.490524:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201406.490535:0:17219:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ce0b9700000 from 1 10000000:01000000:1.0:1788201406.490538:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201406.490594:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.490608:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.490619:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201406.490646:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201406.490709:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.490884:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.492637:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681304448 00000100:00100000:3.0:1788201406.492652:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681304448 00000100:00100000:3.0:1788201406.492721:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201406.492734:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+5:17219:x1875064681304448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201406.492775:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201406.492805:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855ba600/0xf9b71aee44721363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472135c expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.492841:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855ba600/0xf9b71aee44721363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472135c expref: 6 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.492854:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855ba600/0xf9b71aee44721363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472135c expref: 6 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.492864:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba600, rc 0) 00000100:00100000:3.0:1788201406.493074:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+6:17219:x1875064681304448:12345-0@lo:101:mount.lustre.0 Request processed in 342us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.493083:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201406.493535:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201406.493560:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.493589:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201406.493689:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201406.493734:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.493806:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.493882:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681304576 00000100:00100000:2.0:1788201406.493888:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681304576 00000100:00100000:2.0:1788201406.493939:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201406.493948:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+6:17219:x1875064681304576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201406.494050:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+6:17219:x1875064681304576:12345-0@lo:501:mount.lustre.0 Request processed in 103us (315us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201406.494057:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201406.494254:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304576:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788201406.494295:0:17219:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201406.494323:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.494333:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201406.494343:0:17219:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0ba1d3800 10000000:01000000:1.0:1788201406.494349:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201406.494353:0:17219:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ce0ba1d3800 10000000:01000000:1.0:1788201406.494356:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788201406.494360:0:17219:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ce0ba1d3800 from 1 10000000:01000000:1.0:1788201406.494363:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201406.494390:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.494397:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.494406:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201406.494431:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201406.494459:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.494479:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.494507:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681304704 00000100:00100000:3.0:1788201406.494519:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681304704 00000100:00100000:3.0:1788201406.494658:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201406.494667:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+6:17219:x1875064681304704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201406.494677:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201406.494692:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bae00/0xf9b71aee44721371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472136a expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.494712:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bae00/0xf9b71aee44721371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472136a expref: 7 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.494723:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bae00/0xf9b71aee44721371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472136a expref: 7 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.494732:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bae00, rc 0) 00000100:00100000:3.0:1788201406.494791:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+7:17219:x1875064681304704:12345-0@lo:101:mount.lustre.0 Request processed in 126us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.494797:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201406.494864:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201406.494880:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.494889:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201406.494902:0:17219:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788201406.494919:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.494926:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201406.494940:0:17219:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201406.494944:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201406.494949:0:17219:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ce0ba1d3800 10000000:01000000:1.0:1788201406.494952:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201406.494955:0:17219:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788201406.494958:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201406.494971:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.494978:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.494991:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201406.495003:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201406.495030:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.495050:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.495175:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681304832 00000100:00100000:2.0:1788201406.495179:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681304832 00000100:00100000:2.0:1788201406.495200:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201406.495205:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+7:17219:x1875064681304832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201406.495213:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201406.495225:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472137f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721378 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.495240:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472137f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721378 expref: 8 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.495280:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472137f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721378 expref: 8 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.495287:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0e00, rc 0) 00000100:00100000:2.0:1788201406.495326:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+8:17219:x1875064681304832:12345-0@lo:101:mount.lustre.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.495331:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201406.495455:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201406.495466:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.495474:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201406.495531:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201406.495559:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.495582:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.495632:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681304960 00000100:00100000:2.0:1788201406.495636:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681304960 00000100:00100000:2.0:1788201406.495662:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201406.495669:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+8:17219:x1875064681304960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201406.495939:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:17219:x1875064681304960:12345-0@lo:501:mount.lustre.0 Request processed in 261us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.495947:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201406.496208:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681304960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201406.496242:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681305088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201406.496303:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.496336:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1437c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.496387:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681305088 00000100:00100000:2.0:1788201406.496393:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681305088 00000100:00100000:2.0:1788201406.496417:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201406.496423:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:17219:x1875064681305088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201406.509518:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:17219:x1875064681305088:12345-0@lo:503:mount.lustre.0 Request processed in 13081us (13201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.509536:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201406.509707:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681305088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201406.510397:0:17258:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17258:1875064681305216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201406.510464:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.510552:0:17258:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aafa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.512175:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681305216 00000100:00100000:2.0:1788201406.512190:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681305216 00000100:00100000:2.0:1788201406.512276:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201406.512293:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:17258:x1875064681305216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201406.514422:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:17258:x1875064681305216:12345-0@lo:502:llog_process_th.0 Request processed in 2125us (3946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.514439:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201406.521769:0:17258:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17258:1875064681305216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201406.521836:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201406.521856:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.521860:0:17258:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788201406.521866:0:17258:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788201406.521884:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201406.521906:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cdf831ecd40) 00000020:00000080:1.0:1788201406.521942:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788201406.521950:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788201406.522066:0:17258:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788201406.522076:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee4472138d 00000020:00000080:1.0:1788201406.522341:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788201406.522346:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201406.522350:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.522352:0:17258:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788201406.522355:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201406.522360:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.522361:0:17258:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788201406.522364:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201406.522373:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cdf831e99c0) 00000020:00000080:1.0:1788201406.522383:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788201406.522386:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788201406.522388:0:17258:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788201406.522391:0:17258:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788201406.522398:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201406.522439:0:17258:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0ba1d3800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788201406.522453:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cdf831e8000) 00000020:00000080:1.0:1788201406.522460:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788201406.522530:0:17258:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788201406.522536:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee447213a2 00000020:00000080:1.0:1788201406.522645:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788201406.522652:0:17258:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788201406.522657:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf9b71aee447213a9 00080000:01000000:1.0:1788201406.522663:0:17258:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788201406.522666:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee447213b0 00010000:00010000:3.0:1788201406.648297:0:17258:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788201406.649732:0:17258:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788201406.650499:0:17258:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788201406.651499:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ce0bf450000) 00000020:00000080:3.0:1788201406.651528:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788201406.651616:0:17258:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788201406.651634:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee447213be 00000020:00000080:3.0:1788201406.652458:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201406.661581:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf9b71aee447213c5 00000020:00000080:1.0:1788201406.662368:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788201406.662383:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201406.662389:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.662400:0:17258:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788201406.662405:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201406.662408:0:17258:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788201406.662420:0:17258:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201406.662422:0:17258:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201406.662424:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201406.662429:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.662430:0:17258:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201406.662433:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201406.662437:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.662439:0:17258:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788201406.662442:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788201406.662487:0:17258:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788201406.662504:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201406.662508:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.662509:0:17258:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788201406.662512:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201406.662515:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.662517:0:17258:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788201406.662519:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201406.662525:0:17258:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:1.0:1788201406.662565:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201406.662581:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ce0a64399c0) 00000020:00000080:1.0:1788201406.662595:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788201406.662601:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201406.662869:0:17258:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788201406.662875:0:17258:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788201406.662893:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee447213d3 00010000:00080000:1.0:1788201406.663140:0:17258:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0b94fb000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201406.678620:0:17258:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788201406.687284:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201406.687379:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788201406.687519:0:17258:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788201406.687541:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee447213da 00000100:00080000:0.0:1788201406.687689:0:17258:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201406.687698:0:17258:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b94fb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201406.687838:0:17258:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf4e9500 x1875064681305344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201406.687873:0:17258:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788201406.687977:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681305344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201406.688071:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201406.688160:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681305344 00000100:00100000:2.0:1788201406.688167:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681305344 00000100:00100000:2.0:1788201406.688209:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201406.688216:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681305344:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788201406.688231:0:17245:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:0.0:1788201406.689389:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201406.689395:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.689397:0:17258:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788201406.689400:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201406.689403:0:17258:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788201406.689404:0:17258:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201406.689428:0:17258:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201406.689430:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201406.689434:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.689435:0:17258:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201406.689438:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201406.689443:0:17258:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788201406.689447:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.689448:0:17258:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788201406.689451:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201406.689455:0:17258:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:0.0:1788201406.689478:0:17258:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788201406.689481:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201406.689496:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ce0c1500000) 00000020:00000080:0.0:1788201406.689513:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788201406.689517:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201406.689596:0:17258:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788201406.689601:0:17258:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788201406.689608:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee447213e8 00010000:00080000:0.0:1788201406.689645:0:17258:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf821da800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1788201406.689875:0:17258:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788201406.692924:0:17258:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201406.693402:0:17258:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201406.702318:0:17258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201406.705267:0:17258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788201406.713259:0:17258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788201406.724606:0:17264:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788201406.724615:0:17264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788201406.727398:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201406.729873:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201406.730563:0:17258:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788201406.730590:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee447213ef 00000100:00080000:0.0:1788201406.730602:0:17258:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201406.730609:0:17258:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cdf821da800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201406.730655:0:17258:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf4eb800 x1875064681305472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201406.730689:0:17258:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788201406.730823:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201406.730829:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.730831:0:17258:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788201406.730834:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201406.730838:0:17258:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788201406.730839:0:17258:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201406.730841:0:17258:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201406.730843:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201406.730846:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.730848:0:17258:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201406.730851:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201406.730856:0:17258:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788201406.730861:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.730865:0:17258:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788201406.730871:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201406.730874:0:17258:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000100:00080000:1.0:1788201406.730903:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201406.730911:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201406.731012:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681305600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201406.731060:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681305472:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788201406.731139:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681305472 offset 0 length 520: 4 00000100:00100000:1.0:1788201406.731224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.731648:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681305600 00000100:00100000:3.0:1788201406.731656:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681305600 00000100:00100000:3.0:1788201406.731707:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201406.731717:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:3645:x1875064681305600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201406.731810:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:3645:x1875064681305600:12345-0@lo:400:kworker.0 Request processed in 93us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.731817:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201406.732304:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681305600:0@lo:400:kworker.0 00000020:01000000:0.0:1788201406.733153:0:17258:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788201406.733163:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201406.733181:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ce0c1504d40) 00000020:00000080:0.0:1788201406.733202:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788201406.733209:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201406.733316:0:17258:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788201406.733323:0:17258:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788201406.733331:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee447213fd 00010000:00080000:0.0:1788201406.733363:0:17258:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce083419000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1788201406.735252:0:17258:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788201406.735335:0:17258:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201406.735352:0:17258:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788201406.744864:0:17258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201406.748289:0:17258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788201406.748495:0:17258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788201406.749290:0:17266:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788201406.749296:0:17266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788201406.751527:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201406.751543:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201406.751585:0:17258:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788201406.751614:0:17258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44721404 00000100:00080000:0.0:1788201406.751638:0:17258:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201406.751644:0:17258:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce083419000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201406.751678:0:17258:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf4ea300 x1875064681305728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201406.751708:0:17258:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788201406.751773:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681305728:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1788201406.751777:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201406.751783:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.751785:0:17258:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788201406.751788:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201406.751793:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.751795:0:17258:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201406.751798:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201406.751800:0:17258:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201406.751802:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201406.751805:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.751807:0:17258:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788201406.751809:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201406.751812:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201406.751813:0:17258:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201406.751816:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000400:00000100:3.0:1788201406.751833:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681305728 offset 0 length 520: 4 00000100:00100000:0.0:1788201406.751848:0:17258:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17258:1875064681305856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201406.751902:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201406.751931:0:17258:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf837336c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788201406.752050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201406.752055:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201406.752096:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681305856 00000100:00100000:3.0:1788201406.752104:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681305856 00000100:00100000:3.0:1788201406.752157:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201406.752250:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:17258:x1875064681305856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201406.752390:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:17258:x1875064681305856:12345-0@lo:502:llog_process_th.0 Request processed in 225us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.752398:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201406.752617:0:17258:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17258:1875064681305856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201406.752659:0:17258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201406.752664:0:17258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.752666:0:17258:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201406.752671:0:17258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788201406.752955:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788201406.752984:0:17219:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788201406.753006:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.753025:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201406.753033:0:17219:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0ba1d3800 from 1 10000000:01000000:3.0:1788201406.753036:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201406.753068:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.753077:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.753088:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201406.753117:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681305984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201406.753153:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.754461:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08340a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.756301:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681305344:12345-0@lo:38:llog_process_th.0 Request processed in 68077us (68222us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201406.756315:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788201406.758064:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201406.758074:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201406.758080:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681305344:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201406.758710:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681305984 00000100:00100000:1.0:1788201406.758719:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681305984 00000100:00100000:1.0:1788201406.758778:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201406.758788:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+9:17219:x1875064681305984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201406.758804:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201406.758823:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472140b expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.758848:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472140b expref: 10 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.758873:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472140b expref: 10 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.758995:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255a00, rc 0) 00000100:00100000:1.0:1788201406.759239:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+10:17219:x1875064681305984:12345-0@lo:101:mount.lustre.0 Request processed in 453us (6085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201406.759257:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201406.759352:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681305984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201406.759370:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.759379:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201406.760500:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306112:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788201406.760554:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201406.760592:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf83733600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.760791:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681306112 00000100:00100000:3.0:1788201406.760799:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681306112 00000100:00100000:3.0:1788201406.760852:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201406.760861:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+10:17219:x1875064681306112:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788201406.760880:0:17235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788201406.760886:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788201406.760968:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+10:17219:x1875064681306112:12345-0@lo:256:mount.lustre.0 Request processed in 108us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.760983:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201406.762112:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306112:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788201406.762717:0:17219:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201406.762761:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.762772:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201406.762780:0:17219:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0ba1d3800 from 1 10000000:01000000:1.0:1788201406.762782:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201406.762817:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.762824:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.762832:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201406.762852:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201406.763209:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.763259:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.763279:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681306240 00000100:00100000:2.0:1788201406.763287:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681306240 00000100:00100000:2.0:1788201406.763337:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201406.763346:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+10:17219:x1875064681306240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201406.763359:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201406.763375:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721419 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.763397:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721419 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.763408:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721419 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.763417:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1c00, rc 0) 00000100:00100000:2.0:1788201406.763466:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17219:x1875064681306240:12345-0@lo:101:mount.lustre.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.763485:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201406.763592:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201406.763606:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201406.763615:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201406.763809:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201406.763838:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.763950:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201406.764001:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681306368 00000100:00100000:2.0:1788201406.764006:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681306368 00000100:00100000:2.0:1788201406.764065:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201406.764072:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17219:x1875064681306368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201406.764222:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17219:x1875064681306368:12345-0@lo:501:mount.lustre.0 Request processed in 150us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.764229:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201406.764288:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201406.764316:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201406.764356:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.769575:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.770547:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681306496 00000100:00100000:3.0:1788201406.770556:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681306496 00000100:00100000:3.0:1788201406.770608:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201406.770618:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17219:x1875064681306496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201406.771430:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17219:x1875064681306496:12345-0@lo:503:mount.lustre.0 Request processed in 810us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.771443:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201406.771977:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201406.783957:0:17268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17268:1875064681306624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201406.784039:0:17268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.784081:0:17268:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aafc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.786177:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681306624 00000100:00100000:3.0:1788201406.786191:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681306624 00000100:00100000:3.0:1788201406.786262:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201406.786272:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17268:x1875064681306624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201406.790587:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17268:x1875064681306624:12345-0@lo:502:llog_process_th.0 Request processed in 4305us (6537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.790601:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201406.790714:0:17268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17268:1875064681306624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201406.790783:0:17268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201406.790793:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.790795:0:17268:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201406.790802:0:17268:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0ba1d3800 00000020:00000080:1.0:1788201406.790815:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201406.790825:0:17268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201406.790827:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.790829:0:17268:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788201406.790831:0:17268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201406.790834:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.790835:0:17268:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788201406.790839:0:17268:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0ba1d3800 00000020:00000080:1.0:1788201406.790841:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201406.790893:0:17268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201406.790897:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.790898:0:17268:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788201406.790900:0:17268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201406.790903:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.790904:0:17268:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788201406.790907:0:17268:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0ba1d3800 00000020:00000080:1.0:1788201406.790909:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201406.790927:0:17268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201406.790930:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.790931:0:17268:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788201406.790934:0:17268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201406.790936:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201406.790937:0:17268:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788201406.790940:0:17268:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0ba1d3800 00000020:00000080:1.0:1788201406.790942:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788201406.790986:0:17268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17268:1875064681306752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201406.791027:0:17268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.791061:0:17268:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aafc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.796803:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681306752 00000100:00100000:3.0:1788201406.796818:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681306752 00000100:00100000:3.0:1788201406.796876:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201406.796886:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17268:x1875064681306752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201406.797044:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17268:x1875064681306752:12345-0@lo:502:llog_process_th.0 Request processed in 158us (6015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.797051:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201406.797132:0:17268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17268:1875064681306752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201406.797173:0:17268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201406.797180:0:17268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201406.797188:0:17268:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788201406.797193:0:17268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788201406.798000:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788201406.798026:0:17219:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201406.798048:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.798060:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201406.798109:0:17219:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201406.798112:0:17219:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0ba1d3800 10000000:01000000:0.0:1788201406.798115:0:17219:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0ba1d3800 10000000:01000000:0.0:1788201406.798119:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201406.798125:0:17219:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0ba1d3800 from 1 10000000:01000000:0.0:1788201406.798127:0:17219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201406.798171:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.798180:0:17219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.798190:0:17219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201406.798210:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201406.798269:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.798301:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681306880 00000100:00100000:3.0:1788201406.798308:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681306880 00000100:00100000:0.0:1788201406.798314:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf837330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.798336:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201406.798344:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17219:x1875064681306880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201406.798354:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201406.798366:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855ba400/0xf9b71aee4472142e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721427 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.798388:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855ba400/0xf9b71aee4472142e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721427 expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.798396:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855ba400/0xf9b71aee4472142e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721427 expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.798404:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:3.0:1788201406.798449:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17219:x1875064681306880:12345-0@lo:101:mount.lustre.0 Request processed in 106us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.798456:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201406.801284:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681306880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201406.801315:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.801329:0:17219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201406.801406:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681307008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201406.801459:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201406.801491:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf837330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.808305:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681307008 00000100:00100000:3.0:1788201406.808317:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681307008 00000100:00100000:3.0:1788201406.808366:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201406.808375:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17219:x1875064681307008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201406.808537:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17219:x1875064681307008:12345-0@lo:501:mount.lustre.0 Request processed in 162us (7076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.808544:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201406.808725:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681307008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201406.808805:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681307136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201406.808860:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.808899:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce09015f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.809069:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681307136 00000100:00100000:3.0:1788201406.809074:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681307136 00000100:00100000:3.0:1788201406.809107:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201406.809113:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17219:x1875064681307136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201406.809272:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17219:x1875064681307136:12345-0@lo:503:mount.lustre.0 Request processed in 159us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.809279:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201406.809346:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681307136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201406.810530:0:17273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17273:1875064681307264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201406.810582:0:17273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.810608:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681307264 00000100:00100000:3.0:1788201406.810613:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681307264 00000100:00100000:3.0:1788201406.810643:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201406.810651:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17273:x1875064681307264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201406.810775:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17273:x1875064681307264:12345-0@lo:502:llog_process_th.0 Request processed in 124us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.810782:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201406.810827:0:17273:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08bf483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.810843:0:17273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17273:1875064681307264:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788201406.810897:0:17273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788201406.810913:0:17273:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ce0bf453380) 00000020:00000080:3.0:1788201406.810931:0:17273:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788201406.811080:0:17273:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0ba1d3800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788201406.811085:0:17273:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0ba1d3800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788201406.811087:0:17273:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0ba1d3800 4 00010000:00080000:3.0:1788201406.811114:0:17273:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0bf459000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1788201406.828929:0:17273:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788201406.829030:0:17273:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788201406.829074:0:17273:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201406.829092:0:17273:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf9b71aee4472143c 00000100:00080000:3.0:1788201406.829102:0:17273:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201406.829108:0:17273:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ce0bf459000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201406.829143:0:17273:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8410d880 x1875064681307392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201406.829292:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681307392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201406.829359:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201406.829412:0:17273:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201406.830530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201406.830537:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201406.830540:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201406.830546:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:1.0:1788201406.830550:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201406.830555:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b94fb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201406.830580:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a9500 x1875064681307520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201406.831056:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681307392 00000100:00100000:2.0:1788201406.831065:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681307392 00000100:00100000:2.0:1788201406.831102:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201406.831109:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681307392:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201406.831196:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681307392:12345-0@lo:38:llog_process_th.0 Request processed in 86us (1836us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201406.831203:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201406.833321:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681307520:0@lo:38:kworker.0 00000100:00100000:3.0:1788201406.833383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.833437:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201406.833445:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf459000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201406.833449:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201406.833453:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681307392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201406.833569:0:17273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17273:1875064681307648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201406.833608:0:17273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.833628:0:17273:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.834427:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681307520 00000100:00100000:3.0:1788201406.834434:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681307520 00000100:00100000:3.0:1788201406.834458:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201406.834465:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681307520:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201406.834482:0:17246:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201406.834526:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681307520:12345-0@lo:38:kworker.0 Request processed in 60us (1142us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201406.834532:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788201406.834566:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201406.834570:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201406.834574:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681307520:0@lo:38:kworker.0 00000100:00100000:2.0:1788201406.835339:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681307648 00000100:00100000:2.0:1788201406.835345:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681307648 00000100:00100000:2.0:1788201406.835413:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201406.835421:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17273:x1875064681307648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201406.835539:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17273:x1875064681307648:12345-0@lo:502:llog_process_th.0 Request processed in 119us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.835546:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201406.837287:0:17273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17273:1875064681307648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201406.837368:0:17273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17273:1875064681307776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201406.837437:0:17273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.837485:0:17273:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08bf483c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201406.840420:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681307776 00000100:00100000:0.0:1788201406.840432:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681307776 00000100:00100000:0.0:1788201406.840490:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201406.840499:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17273:x1875064681307776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201406.840659:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17273:x1875064681307776:12345-0@lo:502:llog_process_th.0 Request processed in 159us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201406.840667:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201406.840698:0:17273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17273:1875064681307776:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201406.840766:0:17273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788201406.841048:0:17219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788201406.841074:0:17219:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201406.841090:0:17219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.841102:0:17219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201406.841146:0:17219:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201406.841148:0:17219:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201406.841152:0:17219:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201406.841153:0:17219:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201406.841154:0:17219:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201406.841155:0:17219:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201406.841157:0:17219:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201406.841158:0:17219:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201406.841160:0:17219:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201406.841161:0:17219:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201406.841300:0:17219:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788201406.841303:0:17219:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201406.841305:0:17219:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201406.841306:0:17219:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201406.841307:0:17219:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201406.841308:0:17219:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201406.841309:0:17219:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201406.841310:0:17219:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201406.841311:0:17219:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201406.841312:0:17219:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201406.841313:0:17219:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201406.841336:0:17219:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788201406.841351:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681307904:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201406.841391:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201406.841415:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf83733600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201406.841430:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681307904 00000100:00100000:3.0:1788201406.841436:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681307904 00000100:00100000:3.0:1788201406.841476:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201406.841485:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17219:x1875064681307904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201406.841569:0:17235:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201406.841585:0:17235:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788201406.852656:0:17235:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201406.852675:0:17235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788201406.852901:0:17256:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201406.852906:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201406.852927:0:17256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.852956:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472140b expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.852964:0:17256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.853000:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472140b expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201406.853013:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472140b expref: 12 pid: 17233 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201406.853027:0:17256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681308032:0@lo:104: 00000100:00100000:2.0:1788201406.853084:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201406.853120:0:17256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f14cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201406.853413:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681308032 00000100:00100000:0.0:1788201406.853421:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681308032 00000100:00100000:0.0:1788201406.853467:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201406.853475:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:17256:x1875064681308032:12345-0@lo:104: 00010000:00010000:0.0:1788201406.853488:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.853536:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201406.853542:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:17256:x1875064681308032:12345-0@lo:104: Request processed in 68us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201406.853557:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201406.853625:0:17256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681308032:0@lo:104: 00010000:00010000:2.0:1788201406.853643:0:17256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.853786:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201406.853793:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.853801:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201406.853805:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.853814:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201406.853821:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201406.853827:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201406.853856:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.853862:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201406.853879:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.853886:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855bba00/0xf9b71aee4472140b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721412 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.853898:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201406.853900:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201406.853901:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201406.853968:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201406.853978:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681308160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201406.854005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.855492:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17219:x1875064681307904:12345-0@lo:253:mount.lustre.0 Request processed in 14002us (14093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201406.855502:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201406.855604:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17219:1875064681307904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201406.855619:0:17219:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201406.855622:0:17219:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201406.855624:0:17219:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201406.855626:0:17219:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201406.855627:0:17219:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201406.855637:0:17219:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201406.855639:0:17219:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201406.855640:0:17219:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201406.855642:0:17219:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201406.855643:0:17219:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201406.855645:0:17219:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201406.855658:0:17219:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788201406.862537:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681308160 00000100:00100000:0.0:1788201406.862558:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681308160 00010000:00010000:0.0:1788201406.862593:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472140b expref: 12 pid: 17233 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201406.862633:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201406.862643:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:3647:x1875064681308160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201406.862656:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201406.862661:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472140b expref: 12 pid: 17233 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862673:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472140b expref: 12 pid: 17233 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862691:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472140b expref: 12 pid: 17233 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862708:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862716:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201406.862733:0:17225:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009827962s 00010000:00010000:0.0:1788201406.862755:0:17225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862762:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862768:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862784:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862790:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201406.862794:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862802:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862822:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201406.862833:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201406.862907:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:3647:x1875064681308160:12345-0@lo:103:ldlm_bl.0 Request processed in 265us (8899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201406.862915:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201406.864036:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681308160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201406.866336:0:17256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.866353:0:17256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201406.866360:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee44721443 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788201406.895770:0:17219:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788201406.896133:0:17219:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788201406.896287:0:17280:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788201406.896291:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788201406.896594:0:17281:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201406.896773:0:17219:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788201406.897255:0:17281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788201406.897371:0:17282:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ce0bf6aa680 x1875064681308288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201406.897384:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00000040:01000000:3.0:1788201406.898530:0:17219:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788201406.898574:0:17219:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201406.899893:0:17281:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201406.900007:0:17281:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1788201406.902006:0:17219:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788201406.902029:0:17219:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788201406.904891:0:17219:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201406.907975:0:17219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788201406.911179:0:17219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788201406.911265:0:17219:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788201406.918168:0:17219:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788201406.941475:0:17219:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788201406.951290:0:17219:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788201406.951336:0:17219:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc15181973988 00100000:10000000:1.0:1788201406.951344:0:17219:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788201406.952301:0:17219:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201406.952318:0:17219:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201406.952343:0:17219:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788201406.952371:0:17219:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788201406.954320:0:17219:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201406.955373:0:17219:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201407.352700:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201407.862691:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788201407.927613:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 10000000:01000000:3.0:1788201408.312512:0:17237:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201408.312520:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0ba1d3800 from 7 10000000:01000000:3.0:1788201408.312525:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201408.312613:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201408.312626:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201408.312637:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201408.312669:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681308416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201408.312765:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201408.312818:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201408.312934:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681308416 00000100:00100000:2.0:1788201408.312942:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681308416 00000100:00100000:2.0:1788201408.312996:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201408.313006:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+11:17237:x1875064681308416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201408.313019:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201408.313048:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472144a expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.313072:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472144a expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.313083:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472144a expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.313093:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1400, rc 0) 00000100:00100000:2.0:1788201408.313134:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17237:x1875064681308416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201408.313140:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201408.313673:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681308416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201408.313690:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201408.313700:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201408.313791:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681308544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201408.313826:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201408.313848:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201408.313964:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681308544 00000100:00100000:2.0:1788201408.313975:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681308544 00000100:00100000:2.0:1788201408.314010:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201408.314017:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17237:x1875064681308544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201408.314041:0:17235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201408.314056:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201408.314064:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788201408.314151:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17237:x1875064681308544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201408.314159:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201408.314304:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681308544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201408.314347:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201408.314353:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201408.314363:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201408.375036:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201408.886415:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788201408.953723:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:1.0:1788201409.398897:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201409.974988:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:1.0:1788201410.421997:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201410.998246:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:2.0:1788201411.447010:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201411.651705:0:17525:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788201412.021853:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00000100:00080000:3.0:1788201412.214123:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201412.214130:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788201412.214134:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201412.214142:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:3.0:1788201412.214148:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201412.214155:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b94fb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201412.214179:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8410e300 x1875064681308800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201412.214218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201412.214222:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201412.214225:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201412.214228:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201412.214230:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201412.214233:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201412.214235:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf459000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201412.214241:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ce0bf459000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201412.214256:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8410ed80 x1875064681308928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201412.214284:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681308672:0@lo:400:kworker.0 00000100:00100000:3.0:1788201412.214354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201412.214433:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681308672 00000100:00100000:3.0:1788201412.214439:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681308672 00000100:00100000:3.0:1788201412.214483:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201412.214493:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:3647:x1875064681308672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201412.214541:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:3647:x1875064681308672:12345-0@lo:400:kworker.0 Request processed in 50us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201412.214548:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201412.218165:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681308672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201412.218307:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681308800:0@lo:38:kworker.0 00000100:00100000:2.0:1788201412.223638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201412.223679:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681308928:0@lo:38:kworker.0 00000100:00100000:2.0:1788201412.223717:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201412.224594:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681308800 00000100:00100000:3.0:1788201412.224604:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681308800 00000100:00100000:3.0:1788201412.224641:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201412.224656:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681308800:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201412.224675:0:17246:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201412.225897:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681308928 00000100:00100000:1.0:1788201412.225908:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681308928 00000100:00100000:2.0:1788201412.226122:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201412.226130:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681308928:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201412.226157:0:17240:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1788201412.226194:0:17240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf9b71aee44721458 00000004:00100000:2.0:1788201412.226222:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201412.226343:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9ce0b322b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201412.226427:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875064681308928:12345-0@lo:38:kworker.0 Request processed in 296us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201412.226435:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788201412.226480:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cdf8410ed80 x1875064681308928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201412.226498:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788201412.226506:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788201412.226511:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201412.226514:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf459000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201412.226519:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681308928:0@lo:38:kworker.0 00000100:00100000:3.0:1788201412.240693:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681308800:12345-0@lo:38:kworker.0 Request processed in 16028us (17050us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201412.240707:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788201412.240779:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201412.240785:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201412.240789:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681308800:0@lo:38:kworker.0 00010000:00010000:1.0:1788201412.469915:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201412.564568:0:17577:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201412.565114:0:17577:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788201413.050393:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:0.0:1788201413.494260:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201413.641266:0:17627:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201413.641443:0:17627:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788201414.069818:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:1.0:1788201414.519019:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201415.093821:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:2.0:1788201415.543774:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201416.117796:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00000100:00100000:3.0:1788201416.309841:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201406/real 1788201406] req@ffff9ce0bf4ea300 x1875064681305728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201416.309877:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf4ea300 x1875064681305728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201416.309888:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201406/real 1788201406] req@ffff9ce0bf4eb800 x1875064681305472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201416.309898:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf4eb800 x1875064681305472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201416.309926:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201416.309946:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201416.309950:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681305728:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788201416.309957:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201416.309989:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201416.309993:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681305472:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788201416.310333:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201416.310339:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201416.310343:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201416.310348:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:0.0:1788201416.310353:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201416.310360:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b94fb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201416.310381:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf4e8a80 x1875064681309184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201416.310393:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201416.310396:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201416.310398:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201416.310400:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1788201416.310403:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201416.310406:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cdf821da800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201416.310416:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf4e9500 x1875064681309312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201416.310423:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201416.310425:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788201416.310427:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201416.310429:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1788201416.310431:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201416.310434:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce083419000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201416.310444:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf4e8380 x1875064681309440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201416.310552:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681309056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201416.310630:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201416.310685:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201416.310691:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681309568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201416.310720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201416.310785:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681309568 00000100:00100000:1.0:1788201416.310792:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681309568 00000100:00100000:1.0:1788201416.310830:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201416.310840:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681309568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201416.310887:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681309568:12345-0@lo:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201416.310894:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201416.310944:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce0bf4e8000 x1875064681309568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201416.310956:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681309568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201416.311389:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681309184:0@lo:38:kworker.0 00000100:00100000:3.0:1788201416.311422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201416.311451:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681309312:0@lo:8:kworker.0 00000400:00000100:3.0:1788201416.311466:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681309312 offset 0 length 520: 4 00000100:00100000:3.0:1788201416.311482:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681309440:0@lo:8:kworker.0 00000400:00000100:3.0:1788201416.311494:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681309440 offset 0 length 520: 4 00000100:00100000:1.0:1788201416.311567:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681309184 00000100:00100000:1.0:1788201416.311572:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681309184 00000100:00100000:1.0:1788201416.311598:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201416.311603:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681309184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201416.311618:0:17245:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201416.313821:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681309056 00000100:00100000:0.0:1788201416.313831:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681309056 00000100:00100000:0.0:1788201416.313887:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201416.313895:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:3644:x1875064681309056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.314188:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:3644:x1875064681309056:12345-0@lo:400:kworker.0 Request processed in 293us (3557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201416.314196:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201416.320972:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681309056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201416.335505:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681309184:12345-0@lo:38:kworker.0 Request processed in 23892us (24073us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201416.335520:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788201416.335666:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201416.335674:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201416.335677:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681309184:0@lo:38:kworker.0 00010000:00010000:1.0:1788201416.565877:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201417.142095:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:2.0:1788201417.593713:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201418.102383:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788201418.171708:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:1.0:1788201418.613897:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201419.189969:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:0.0:1788201419.641260:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201420.216941:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00000020:01000004:2.0:1788201420.357788:0:17972:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201420.357792:0:17972:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788201420.357793:0:17972:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788201420.357910:0:17972:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ce0b3251800 00000020:01000004:2.0:1788201420.357926:0:17972:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788201420.357937:0:17972:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788201420.357950:0:17972:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ce0b9703380) 00000020:00000080:2.0:1788201420.357966:0:17972:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201420.452415:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788201420.453257:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.457655:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.458309:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.458494:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.460374:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.460778:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.461089:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.461331:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.461651:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.461887:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.462214:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.462451:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.462764:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.463042:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.463248:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.463449:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.463676:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.464524:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.464992:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.465516:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.465768:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.466063:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.466359:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.466592:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.466898:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.467217:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.467427:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.468606:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.469284:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.469559:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.469897:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788201420.470292:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.471095:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788201420.475225:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788201420.475717:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788201420.476254:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788201420.476488:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788201420.476669:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788201420.477071:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788201420.477267:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788201420.477501:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201420.477679:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788201420.478123:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788201420.478368:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201420.479037:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788201420.479729:0:17972:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201420.480198:0:17972:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788201420.480210:0:17972:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201420.480229:0:17972:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44721466 00000020:01000004:3.0:1788201420.480236:0:17972:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788201420.480259:0:17972:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201420.480262:0:17972:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201420.480267:0:17972:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788201420.480295:0:17972:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788201420.480300:0:17972:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788201420.495768:0:17972:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201420.495816:0:17972:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788201420.495821:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201420.495823:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201420.495824:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201420.495825:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201420.495826:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201420.495827:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201420.495828:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201420.495830:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201420.495831:0:17972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201420.495834:0:17972:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788201420.495836:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201420.495837:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201420.495838:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201420.495839:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201420.495840:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201420.495841:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201420.495842:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201420.495843:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201420.495844:0:17972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201420.495868:0:17972:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788201420.495888:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681309696:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201420.497179:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201420.497280:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.500580:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681309696 00000100:00100000:3.0:1788201420.500596:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681309696 00000100:00100000:0.0:1788201420.500965:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201420.500975:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17972:x1875064681309696:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201420.501012:0:17235:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788201420.501015:0:17235:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788201420.501023:0:17235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788201420.502257:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17972:x1875064681309696:12345-0@lo:253:mount.lustre.0 Request processed in 1278us (5077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.502267:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201420.502366:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681309696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201420.502380:0:17972:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788201420.502392:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201420.502394:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788201420.502395:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201420.502397:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201420.502398:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201420.502412:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201420.502413:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201420.502415:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201420.502416:0:17972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201420.502434:0:17972:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0b3251800 from lustre-MDT0001 10000000:01000000:2.0:1788201420.502477:0:17972:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788201420.502480:0:17972:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788201420.502486:0:17972:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0b9700000 local copy 00010000:00010000:2.0:1788201420.502495:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.502591:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681309824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201420.502625:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.502660:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.502869:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681309824 00000100:00100000:0.0:1788201420.502875:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681309824 00000100:00100000:0.0:1788201420.502908:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201420.502916:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17972:x1875064681309824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201420.503143:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17972:x1875064681309824:12345-0@lo:501:mount.lustre.0 Request processed in 226us (515us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201420.503159:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201420.503267:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681309824:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788201420.503281:0:17972:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788201420.503298:0:17972:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788201420.503303:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.503312:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.503334:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0b3251800 10000000:01000000:2.0:1788201420.503339:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201420.503343:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ce0b9700000 10000000:01000000:2.0:1788201420.503346:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788201420.503349:0:17972:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9ce0b9700000 from 1 10000000:01000000:2.0:1788201420.503352:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788201420.503375:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.503453:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.503463:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.503477:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681309952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201420.503503:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.503531:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.503606:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681309952 00000100:00100000:3.0:1788201420.503611:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681309952 00000100:00100000:3.0:1788201420.503646:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201420.503654:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+12:17972:x1875064681309952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201420.503663:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201420.503675:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44721474 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472146d expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.503694:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44721474 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472146d expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.503703:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44721474 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472146d expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.503712:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:3.0:1788201420.503956:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+13:17972:x1875064681309952:12345-0@lo:101:mount.lustre.0 Request processed in 302us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.503963:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201420.504121:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681309952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201420.504133:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721474 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.504143:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721474 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.504169:0:17972:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788201420.504183:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721474 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.504190:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721474 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.504198:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ce0b3251800 10000000:01000000:2.0:1788201420.504201:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788201420.504205:0:17972:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ce0b3251800 from 1 10000000:01000000:2.0:1788201420.504207:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788201420.504227:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.504235:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.504243:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.504255:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201420.504280:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.504400:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.507215:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681310080 00000100:00100000:1.0:1788201420.507228:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681310080 00000100:00100000:1.0:1788201420.507323:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201420.507334:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+13:17972:x1875064681310080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201420.507352:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201420.507370:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255c00/0xf9b71aee44721482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472147b expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.507403:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255c00/0xf9b71aee44721482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472147b expref: 14 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.507414:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255c00/0xf9b71aee44721482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472147b expref: 14 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.507422:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255c00, rc 0) 00000100:00100000:1.0:1788201420.507494:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+14:17972:x1875064681310080:12345-0@lo:101:mount.lustre.0 Request processed in 162us (3213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.507500:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201420.507631:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201420.507648:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.507657:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.507675:0:17972:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788201420.507694:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.507708:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.507716:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788201420.507721:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201420.507726:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ce0b3251800 10000000:01000000:2.0:1788201420.507765:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788201420.507769:0:17972:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788201420.507771:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201420.507793:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.507800:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.507809:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.507825:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201420.507854:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.507879:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.508145:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681310208 00000100:00100000:0.0:1788201420.508158:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681310208 00000100:00100000:1.0:1788201420.508382:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201420.508390:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+14:17972:x1875064681310208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201420.508399:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201420.508407:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721489 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.508432:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721489 expref: 15 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.508441:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721489 expref: 15 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.508449:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255a00, rc 0) 00000100:00100000:1.0:1788201420.508484:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310208:12345-0@lo:101:mount.lustre.0 Request processed in 96us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.508490:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201420.508563:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201420.508575:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.508583:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201420.510548:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788201420.511639:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201420.521716:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788201420.523136:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788201420.523171:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788201420.523186:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788201420.523199:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1788201420.523211:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1788201420.523237:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1788201420.523252:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788201420.523265:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788201420.523276:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1788201420.523289:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1788201420.523301:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1788201420.523314:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1788201420.523326:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788201420.523339:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788201420.523351:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1788201420.523364:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788201420.523376:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788201420.525427:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1788201420.525452:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788201420.525468:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788201420.525483:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788201420.525496:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788201420.525531:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1788201420.525537:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1788201420.525643:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201420.525719:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.525838:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.530079:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681310336 00000100:00100000:1.0:1788201420.530093:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681310336 00000100:00100000:1.0:1788201420.530219:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201420.530229:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201420.530448:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310336:12345-0@lo:501:mount.lustre.0 Request processed in 220us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.530455:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201420.530549:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201420.530600:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201420.530658:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.531650:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.531724:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681310464 00000100:00100000:0.0:1788201420.531730:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681310464 00000100:00100000:0.0:1788201420.531787:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201420.531796:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201420.533282:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310464:12345-0@lo:503:mount.lustre.0 Request processed in 1482us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.533295:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201420.534245:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201420.536312:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201420.536721:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201420.536906:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.536961:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.537119:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681310592 00000100:00100000:1.0:1788201420.537126:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681310592 00000100:00100000:1.0:1788201420.537182:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201420.537191:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201420.538138:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310592:12345-0@lo:502:mount.lustre.0 Request processed in 945us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.538155:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201420.538305:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201420.540217:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788201420.540267:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788201420.540281:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788201420.540295:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788201420.540309:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788201420.540321:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788201420.540333:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788201420.540345:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788201420.540357:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788201420.540369:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788201420.540509:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788201420.540530:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788201420.540546:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788201420.540558:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788201420.540569:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788201420.540580:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788201420.540591:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788201420.540603:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788201420.540615:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788201420.540628:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788201420.540640:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788201420.540652:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788201420.540664:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788201420.540676:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788201420.540689:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788201420.540701:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788201420.540713:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788201420.540725:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788201420.540891:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788201420.540907:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788201420.540920:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788201420.540932:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788201420.541069:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788201420.541088:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788201420.541101:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788201420.541113:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788201420.541126:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788201420.541138:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788201420.541162:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788201420.541177:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788201420.541191:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788201420.541222:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788201420.541237:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788201420.541249:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788201420.541293:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201420.541365:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.541618:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.542256:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681310720 00000100:00100000:3.0:1788201420.542264:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681310720 00000100:00100000:3.0:1788201420.542353:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201420.542373:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201420.542654:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681310720:12345-0@lo:502:mount.lustre.0 Request processed in 282us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.542661:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201420.542786:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681310720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201420.542862:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788201420.542883:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788201420.544158:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201420.544171:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201420.544173:0:17976:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788201420.544182:0:17976:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788201420.544185:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201420.544199:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9ce0c1503380) 00000020:00000080:0.0:1788201420.544219:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788201420.544224:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788201420.544289:0:17976:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788201420.544296:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee4472149e 00000020:00000080:0.0:1788201420.544631:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788201420.544637:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201420.544640:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201420.544642:0:17976:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788201420.544645:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201420.544648:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201420.544649:0:17976:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788201420.544652:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201420.544659:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ce0c15019c0) 00000020:00000080:0.0:1788201420.544671:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788201420.544675:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788201420.544677:0:17976:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788201420.544680:0:17976:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788201420.544685:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201420.544725:0:17976:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0b3251800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788201420.544921:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ce0a6583380) 00000020:00000080:0.0:1788201420.544932:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788201420.545118:0:17976:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201420.545124:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee447214b3 00000020:00000080:0.0:1788201420.545233:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788201420.545240:0:17976:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201420.545245:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf9b71aee447214ba 00080000:01000000:0.0:1788201420.545257:0:17976:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201420.545262:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee447214c1 00010000:00010000:1.0:1788201420.664125:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201420.700753:0:17976:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788201420.701543:0:17976:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788201420.701987:0:17976:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788201420.705686:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788201420.705838:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201420.705846:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201420.705848:0:17976:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788201420.705852:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201420.705859:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201420.705860:0:17976:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788201420.705863:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201420.705868:0:17976:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:1.0:1788201420.705895:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201420.705909:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ce0a643b380) 00000020:00000080:1.0:1788201420.705930:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788201420.705935:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201420.706192:0:17976:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788201420.706200:0:17976:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788201420.706207:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee447214cf 00010000:00080000:1.0:1788201420.706238:0:17976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0870d7800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201420.717379:0:17976:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788201420.726567:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788201420.726583:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788201420.726629:0:17976:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788201420.726653:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee447214d6 00000100:00080000:2.0:1788201420.726663:0:17976:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201420.726670:0:17976:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce0870d7800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201420.726706:0:17976:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf837a4380 x1875064681310848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201420.726785:0:17976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201420.726829:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201420.726833:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788201420.726835:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201420.726840:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788201420.727017:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201420.727024:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b94fb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201420.727040:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf837a4a80 x1875064681311104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201420.727051:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201420.727054:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201420.727057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201420.727060:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788201420.727122:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201420.727127:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.727129:0:17976:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788201420.727132:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201420.727135:0:17976:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788201420.727136:0:17976:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201420.727137:0:17976:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201420.727138:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201420.727141:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.727142:0:17976:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201420.727156:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201420.727162:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.727164:0:17976:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788201420.727168:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201420.727213:0:17976:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201420.727227:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201420.727229:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.727231:0:17976:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788201420.727233:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201420.727235:0:17976:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788201420.727236:0:17976:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201420.727237:0:17976:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201420.727239:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201420.727241:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.727243:0:17976:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201420.727245:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201420.727248:0:17976:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788201420.727250:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.727252:0:17976:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201420.727254:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201420.727258:0:17976:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:2.0:1788201420.727428:0:17976:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788201420.727433:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201420.727446:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ce0b9704d40) 00000020:00000080:2.0:1788201420.727458:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788201420.727464:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201420.727536:0:17976:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788201420.727543:0:17976:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201420.727549:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee447214e4 00010000:00080000:2.0:1788201420.727581:0:17976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0a026b800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.102@tcp at head 00000100:00100000:3.0:1788201420.727834:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681310976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.727920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.727920:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681310848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201420.727972:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201420.727979:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681311232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.728002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.728037:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681310976 00000100:00100000:3.0:1788201420.728042:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681310976 00000100:00100000:1.0:1788201420.728044:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.728068:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681311104:0@lo:38:kworker.0 00000100:00100000:3.0:1788201420.728086:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201420.728095:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:3646:x1875064681310976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.728140:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:3646:x1875064681310976:12345-0@lo:400:kworker.0 Request processed in 46us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.728159:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201420.728198:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681311232 00000100:00100000:3.0:1788201420.728202:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681311232 00000100:00100000:3.0:1788201420.728225:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201420.728231:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681311232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.728260:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681311232:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.728266:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201420.728564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.728603:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681310848 00000100:00100000:1.0:1788201420.728607:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681310848 00010000:00010000:2.0:1788201420.728616:0:17976:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788201420.728623:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681311104 00000100:00100000:1.0:1788201420.728627:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681311104 00000100:00100000:1.0:1788201420.728642:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201420.728648:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681310848:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201420.728670:0:17245:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:1.0:1788201420.728817:0:17245:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee447214eb 00000004:00100000:1.0:1788201420.728831:0:17245:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788201420.728843:0:17245:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:3.0:1788201420.728980:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cdf837a7b80 x1875064681311232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201420.728994:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681311232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.729015:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681310976:0@lo:400:kworker.0 00000040:01000000:2.0:1788201420.730466:0:17976:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201420.730681:0:17976:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788201420.736534:0:17976:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201420.737077:0:17976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00080000:1.0:1788201420.738421:0:17245:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9737800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201420.738521:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681310848:12345-0@lo:38:llog_process_th.0 Request processed in 9870us (10476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.738533:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1788201420.738536:0:17976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1788201420.738561:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201420.738569:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681311104:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788201420.738609:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681311104:12345-0@lo:38:kworker.0 Request processed in 41us (10046us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201420.738615:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201420.738773:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201420.738783:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788201420.738791:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788201420.738796:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201420.738799:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201420.738874:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681310848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201420.738892:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201420.738897:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201420.738902:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201420.738905:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681311104:0@lo:38:kworker.0 00000040:00080000:3.0:1788201420.739805:0:17981:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788201420.739810:0:17981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788201420.741222:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201420.741237:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201420.741291:0:17976:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201420.741313:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee447214f2 00000100:00080000:3.0:1788201420.741322:0:17976:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201420.741328:0:17976:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce0a026b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201420.741363:0:17976:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8410d500 x1875064681311360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201420.741508:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681311360:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788201420.741575:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681311360 offset 0 length 520: 4 00000100:00080000:3.0:1788201420.741626:0:17976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788201420.741690:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201420.741695:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.741697:0:17976:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788201420.741719:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201420.741722:0:17976:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788201420.741724:0:17976:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201420.741725:0:17976:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201420.741727:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201420.741730:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.741731:0:17976:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201420.741734:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201420.741762:0:17976:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788201420.741767:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.741769:0:17976:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788201420.741772:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201420.741776:0:17976:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:3.0:1788201420.741796:0:17976:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788201420.741799:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201420.741810:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ce0bf454d40) 00000020:00000080:3.0:1788201420.741822:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788201420.741827:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201420.741884:0:17976:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788201420.741891:0:17976:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788201420.741897:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44721500 00010000:00080000:3.0:1788201420.741927:0:17976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0bf443000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1788201420.742128:0:17976:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788201420.742207:0:17976:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201420.742224:0:17976:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788201420.742559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201420.742564:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201420.742567:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201420.742570:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788201420.744689:0:17976:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201420.745063:0:17976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788201420.745401:0:17976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:0.0:1788201420.745797:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201420.745819:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681311488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201420.745888:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.745964:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681311488 00000100:00100000:2.0:1788201420.745971:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681311488 00000100:00100000:2.0:1788201420.746029:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201420.746040:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875064681311488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201420.746072:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788201420.746137:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875064681311488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.746153:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1788201420.746237:0:17983:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788201420.746241:0:17983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788201420.746411:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681311488:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788201420.747134:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201420.747158:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201420.747430:0:17976:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788201420.747454:0:17976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44721507 00000100:00080000:1.0:1788201420.747463:0:17976:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201420.747468:0:17976:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce0bf443000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201420.747496:0:17976:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8700 x1875064681311616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201420.747523:0:17976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788201420.747619:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681311616:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1788201420.747626:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201420.747631:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201420.747633:0:17976:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788201420.747637:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201420.747642:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201420.747643:0:17976:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788201420.747648:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788201420.747650:0:17976:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788201420.747663:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000400:00000100:2.0:1788201420.747665:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681311616 offset 0 length 520: 4 00000020:00000080:1.0:1788201420.747667:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201420.747671:0:17976:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788201420.747677:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201420.747680:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201420.747681:0:17976:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201420.747686:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788201420.747725:0:17976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201420.747729:0:17976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201420.747730:0:17976:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201420.747734:0:17976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788201420.747820:0:17972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788201420.747856:0:17972:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788201420.747873:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.747885:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.747892:0:17972:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b3251800 from 1 10000000:01000000:2.0:1788201420.747895:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201420.747919:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.747927:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.747943:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.747959:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681311744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201420.747991:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.748019:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.748046:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681311744 00000100:00100000:1.0:1788201420.748052:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681311744 00000100:00100000:1.0:1788201420.748096:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201420.748105:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+15:17972:x1875064681311744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201420.748117:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201420.748131:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472150e expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.748164:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472150e expref: 16 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.749090:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472150e expref: 16 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.749102:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255600, rc 0) 00000100:00100000:1.0:1788201420.749170:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:17972:x1875064681311744:12345-0@lo:101:mount.lustre.0 Request processed in 1066us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.749184:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201420.749474:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681311744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201420.749493:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.749504:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201420.749819:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201420.749824:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201420.749827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201420.749838:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201420.750085:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681311872:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788201420.750134:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.750178:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a088b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.750671:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681311872 00000100:00100000:1.0:1788201420.750678:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681311872 00000100:00100000:1.0:1788201420.750834:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201420.750923:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:17972:x1875064681311872:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788201420.751025:0:17235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788201420.751042:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201420.751045:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788201420.751168:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:17972:x1875064681311872:12345-0@lo:256:mount.lustre.0 Request processed in 324us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.751206:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681311872:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788201420.751327:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 10000000:01000000:2.0:1788201420.752024:0:17972:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201420.752047:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.752058:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201420.757067:0:17972:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b3251800 from 1 10000000:01000000:3.0:1788201420.757076:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201420.757124:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.758916:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.758940:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201420.758971:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201420.759239:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.759284:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.759311:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681312000 00000100:00100000:1.0:1788201420.759320:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681312000 00000100:00100000:1.0:1788201420.759375:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201420.759385:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:17972:x1875064681312000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201420.759398:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201420.759414:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472151c expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.759441:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472151c expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.759452:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472151c expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.759463:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254e00, rc 0) 00000100:00100000:1.0:1788201420.759514:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312000:12345-0@lo:101:mount.lustre.0 Request processed in 130us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.759522:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201420.759660:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201420.759675:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.759684:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201420.760130:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201420.760249:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201420.760284:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.760367:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201420.767184:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681312128 00000100:00100000:2.0:1788201420.767199:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681312128 00000100:00100000:2.0:1788201420.767283:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201420.767293:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201420.767462:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312128:12345-0@lo:501:mount.lustre.0 Request processed in 170us (7176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.767470:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201420.767619:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201420.767667:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201420.767719:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.767784:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201420.768071:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681312256 00000100:00100000:2.0:1788201420.768076:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681312256 00000100:00100000:2.0:1788201420.768112:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201420.768120:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201420.768223:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312256:12345-0@lo:503:mount.lustre.0 Request processed in 104us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.768230:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201420.768345:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201420.768695:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201420.768907:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201420.769077:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.769182:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.770262:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681312384 00000100:00100000:1.0:1788201420.770270:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681312384 00000100:00100000:1.0:1788201420.770360:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201420.770379:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201420.770514:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312384:12345-0@lo:502:mount.lustre.0 Request processed in 136us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.770521:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201420.770613:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201420.770865:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788201420.770893:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788201420.770905:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788201420.770916:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788201420.770927:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788201420.770938:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788201420.770964:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788201420.770979:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788201420.770992:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788201420.771005:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788201420.771017:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788201420.771046:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201420.771089:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.771647:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201420.771708:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681312512 00000100:00100000:2.0:1788201420.771715:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681312512 00000100:00100000:2.0:1788201420.771771:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201420.771780:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201420.772327:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312512:12345-0@lo:502:mount.lustre.0 Request processed in 546us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.772335:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201420.772432:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201420.772497:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788201420.772508:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788201420.774613:0:17985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201420.774625:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.774633:0:17985:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201420.774640:0:17985:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0b3251800 00000020:00000080:3.0:1788201420.774643:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201420.774651:0:17985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201420.774654:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.774655:0:17985:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201420.774657:0:17985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201420.774660:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.774661:0:17985:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201420.774664:0:17985:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0b3251800 00000020:00000080:3.0:1788201420.774666:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201420.774725:0:17985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201420.774729:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.774731:0:17985:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788201420.774733:0:17985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201420.774735:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.774755:0:17985:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788201420.774760:0:17985:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0b3251800 00000020:00000080:3.0:1788201420.774762:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201420.774782:0:17985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201420.774785:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.774786:0:17985:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788201420.774788:0:17985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201420.774790:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.774791:0:17985:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788201420.774795:0:17985:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0b3251800 00000020:00000080:3.0:1788201420.774796:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201420.774817:0:17985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201420.774820:0:17985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201420.774822:0:17985:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788201420.774825:0:17985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788201420.777161:0:17972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788201420.777203:0:17972:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201420.777228:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.777247:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201420.777298:0:17972:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201420.777301:0:17972:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0b3251800 10000000:01000000:3.0:1788201420.777304:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0b3251800 10000000:01000000:3.0:1788201420.777307:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201420.777313:0:17972:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0b3251800 from 1 10000000:01000000:3.0:1788201420.777315:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201420.777346:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.777354:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.777365:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201420.777388:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201420.777450:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.777487:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681312640 00000100:00100000:3.0:1788201420.777493:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681312640 00000100:00100000:3.0:1788201420.777523:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201420.777531:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17972:x1875064681312640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201420.777543:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201420.777555:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855ba000/0xf9b71aee44721531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472152a expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.777589:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855ba000/0xf9b71aee44721531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472152a expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.777598:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855ba000/0xf9b71aee44721531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472152a expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.777606:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba000, rc 0) 00000100:00100000:3.0:1788201420.777637:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681312640:12345-0@lo:101:mount.lustre.0 Request processed in 107us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.777644:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201420.777684:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce094574600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.777704:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201420.777718:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.777727:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201420.782095:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788201420.782396:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201420.782590:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788201420.782615:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788201420.782630:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788201420.782643:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788201420.782657:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788201420.782668:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788201420.782681:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788201420.782694:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788201420.782720:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788201420.782734:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788201420.782770:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788201420.782783:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788201420.782793:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788201420.782802:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788201420.782823:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788201420.782835:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788201420.782845:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788201420.782856:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788201420.782866:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788201420.782876:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788201420.782886:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788201420.782896:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788201420.782906:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788201420.782917:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788201420.782928:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788201420.782939:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788201420.784819:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788201420.784832:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788201420.784852:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788201420.784857:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788201420.784963:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201420.785021:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.785063:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.785212:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681312768 00000100:00100000:0.0:1788201420.785219:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681312768 00000100:00100000:0.0:1788201420.785308:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201420.785316:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681312768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201420.785432:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681312768:12345-0@lo:501:mount.lustre.0 Request processed in 117us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.785439:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201420.785477:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201420.785506:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201420.785545:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201420.785557:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.785567:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681312896 00000100:00100000:0.0:1788201420.785571:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681312896 00000100:00100000:0.0:1788201420.785586:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201420.785591:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681312896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201420.785667:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681312896:12345-0@lo:503:mount.lustre.0 Request processed in 75us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.785680:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201420.785718:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681312896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201420.786256:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201420.786328:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681313024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201420.786361:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201420.786394:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.788091:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681313024 00000100:00100000:3.0:1788201420.788102:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681313024 00000100:00100000:3.0:1788201420.788168:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201420.788178:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681313024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201420.788318:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681313024:12345-0@lo:502:mount.lustre.0 Request processed in 142us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.788333:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201420.788392:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681313024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201420.788602:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788201420.788632:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788201420.788647:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788201420.788660:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788201420.788673:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788201420.788687:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788201420.788698:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788201420.788710:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788201420.788722:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788201420.788775:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788201420.788793:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788201420.788808:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788201420.788819:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788201420.788832:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788201420.788843:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788201420.788855:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788201420.788867:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788201420.788879:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788201420.788890:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788201420.788902:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788201420.788914:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788201420.788927:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788201420.788938:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788201420.790605:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788201420.790622:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788201420.790650:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788201420.790666:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788201420.790679:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788201420.790706:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788201420.790719:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788201420.790731:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788201420.790761:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788201420.790775:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788201420.790787:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788201420.790800:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788201420.790812:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788201420.790825:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788201420.790838:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788201420.790851:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788201420.790862:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788201420.790874:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788201420.790898:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788201420.790910:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788201420.790920:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788201420.790931:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788201420.795988:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788201420.796043:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788201420.796062:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788201420.796121:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681313152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201420.796209:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.796259:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.796344:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681313152 00000100:00100000:3.0:1788201420.796351:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681313152 00000100:00100000:3.0:1788201420.796398:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201420.796407:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681313152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201420.796519:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681313152:12345-0@lo:502:mount.lustre.0 Request processed in 113us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.796528:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201420.796591:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681313152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201420.796781:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788201420.796803:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788201420.796826:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681313280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201420.796861:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.796872:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.796889:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681313280 00000100:00100000:3.0:1788201420.796893:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681313280 00000100:00100000:3.0:1788201420.796914:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201420.796920:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681313280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201420.796987:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681313280:12345-0@lo:502:mount.lustre.0 Request processed in 66us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.796994:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201420.797031:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681313280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201420.797065:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788201420.797073:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788201420.804542:0:17989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788201420.804560:0:17989:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9cdf821d3380) 00000020:00000080:3.0:1788201420.804585:0:17989:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788201420.804786:0:17989:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0b3251800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788201420.804791:0:17989:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0b3251800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788201420.804793:0:17989:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0b3251800 3 00010000:00080000:3.0:1788201420.804821:0:17989:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0a02e8000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1788201420.806386:0:17989:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788201420.806499:0:17989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788201420.806540:0:17989:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201420.806552:0:17989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf9b71aee4472153f 00000100:00080000:3.0:1788201420.806561:0:17989:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201420.806575:0:17989:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ce0a02e8000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201420.806608:0:17989:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8410ea00 x1875064681313408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201420.806658:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681313408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201420.806721:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.806802:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681313408 00000100:00100000:3.0:1788201420.806808:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681313408 00000100:00100000:3.0:1788201420.806838:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201420.806845:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681313408:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201420.806866:0:17240:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:3.0:1788201420.806902:0:17240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf9b71aee44721546 00000004:00100000:3.0:1788201420.806918:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201420.806943:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02ee000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201420.806995:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875064681313408:12345-0@lo:38:llog_process_th.0 Request processed in 149us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.807002:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788201420.807038:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cdf8410ea00 x1875064681313408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201420.807047:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201420.807054:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788201420.807060:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788201420.807064:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201420.807065:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201420.807070:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681313408:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788201420.807089:0:17989:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201420.807115:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201420.807119:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201420.807122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201420.807124:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788201420.815040:0:17989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788201420.817850:0:17972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788201420.817892:0:17972:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201420.817916:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.817928:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201420.817988:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201420.817990:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788201420.817991:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201420.817992:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201420.817993:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201420.817995:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201420.817996:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201420.817998:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201420.818000:0:17972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201420.818003:0:17972:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788201420.818005:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201420.818007:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788201420.818008:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201420.818009:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201420.818010:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201420.818011:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201420.818012:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201420.818013:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201420.818014:0:17972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201420.818039:0:17972:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788201420.818060:0:17972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681313536:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201420.818129:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.818185:0:17972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201420.818211:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681313536 00000100:00100000:2.0:1788201420.818218:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681313536 00000100:00100000:2.0:1788201420.818260:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201420.818268:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681313536:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201420.818293:0:17235:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788201420.818306:0:17235:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788201420.821701:0:17220:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788201420.821818:0:17235:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201420.821831:0:17235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788201420.821998:0:17256:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201420.822004:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201420.822037:0:17256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.822054:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472144a expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.822061:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472150e expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.822067:0:17256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.822101:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472150e expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.822115:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472150e expref: 18 pid: 17233 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.822129:0:17256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681313664:0@lo:104: 00000100:00100000:2.0:1788201420.822204:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201420.822251:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472144a expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.822259:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472144a expref: 18 pid: 17234 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.822266:0:17256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681313792:0@lo:104: 00000100:00100000:2.0:1788201420.822287:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.824967:0:17256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.827876:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17972:x1875064681313536:12345-0@lo:253:mount.lustre.0 Request processed in 9601us (9739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.827890:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201420.830668:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681313664 00000100:00100000:0.0:1788201420.830679:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681313664 00000100:00100000:2.0:1788201420.830791:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681313792 00000100:00100000:2.0:1788201420.830796:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681313792 00000100:00100000:2.0:1788201420.830835:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201420.830845:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:17256:x1875064681313792:12345-0@lo:104: 00010000:00010000:2.0:1788201420.830862:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201420.831069:0:17256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681313792:0@lo:104: 00010000:00010000:2.0:1788201420.831117:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201420.831123:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:17256:x1875064681313792:12345-0@lo:104: Request processed in 281us (8835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.831131:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201420.831193:0:17972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17972:1875064681313536:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201420.831207:0:17972:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788201420.831210:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201420.831212:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788201420.831213:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201420.831215:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201420.831216:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201420.831217:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201420.831219:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201420.831220:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201420.831222:0:17972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201420.831236:0:17972:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788201420.831768:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201420.831777:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.831787:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201420.831791:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.831800:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201420.831807:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201420.831812:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201420.831848:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.831854:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201420.831883:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.831890:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb000/0xf9b71aee4472144a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721451 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.831902:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201420.831903:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201420.831905:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201420.831932:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681313920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201420.832201:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201420.832210:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:17256:x1875064681313664:12345-0@lo:104: 00010000:00010000:1.0:1788201420.832220:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.832277:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201420.832283:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:17256:x1875064681313664:12345-0@lo:104: Request processed in 75us (10079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.832290:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788201420.832311:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201420.832316:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.832323:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201420.832326:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.832332:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201420.832339:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201420.832343:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201420.832369:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.832375:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201420.832385:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.832391:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0000/0xf9b71aee4472150e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721515 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.832403:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201420.832404:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201420.832406:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201420.832646:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201420.832691:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681313920 00000100:00100000:0.0:1788201420.832697:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681313920 00010000:00010000:0.0:1788201420.832715:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472144a expref: 18 pid: 17234 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201420.832762:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201420.832769:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:3645:x1875064681313920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201420.832780:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201420.832786:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472144a expref: 18 pid: 17234 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.832794:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472144a expref: 18 pid: 17234 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.832807:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472144a expref: 18 pid: 17234 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.832820:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201420.832848:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:3645:x1875064681313920:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.832862:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201420.832894:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681313920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201420.832975:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681314048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201420.833005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.833058:0:17256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681313664:0@lo:104: 00010000:00010000:3.0:1788201420.833076:0:17256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201420.833662:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681314048 00000100:00100000:0.0:1788201420.833667:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681314048 00010000:00010000:0.0:1788201420.833687:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472150e expref: 17 pid: 17233 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201420.833710:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201420.833717:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:3646:x1875064681314048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201420.833725:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201420.833729:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472150e expref: 17 pid: 17233 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833768:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472150e expref: 17 pid: 17233 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833780:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255600/0xf9b71aee44721515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472150e expref: 17 pid: 17233 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833792:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833799:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201420.833812:0:17227:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011809503s 00010000:00010000:0.0:1788201420.833816:0:17227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833833:0:17227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833839:0:17227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833846:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833852:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201420.833856:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833863:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833877:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.833886:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201420.833922:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:3646:x1875064681314048:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.833930:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201420.834015:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681314048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201420.834036:0:17256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.834043:0:17256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.834049:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0c00/0xf9b71aee4472154d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1788201420.859548:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788201420.859673:0:17997:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788201420.859678:0:17997:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788201420.859772:0:17998:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201420.860025:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788201420.860364:0:17998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201420.862531:0:17998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788201420.862621:0:17998:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1788201420.862898:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788201420.862931:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201420.864864:0:17999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1875064681314176:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201420.864931:0:17999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.864976:0:17999:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.865293:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681314176 00000100:00100000:1.0:1788201420.865301:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681314176 00000100:00100000:1.0:1788201420.865349:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201420.865358:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17999:x1875064681314176:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201420.865445:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17999:x1875064681314176:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 88us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.865453:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201420.865535:0:17999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1875064681314176:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788201420.865566:0:17999:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788201420.865591:0:17999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1875064681314304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201420.865633:0:17999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.865658:0:17999:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.865716:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681314304 00000100:00100000:0.0:1788201420.865721:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681314304 00000100:00100000:0.0:1788201420.865777:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201420.865784:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17999:x1875064681314304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201420.865893:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17999:x1875064681314304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 108us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.865910:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201420.865985:0:17999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1875064681314304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201420.866039:0:17999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17999:1875064681314432:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788201420.866066:0:17999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.866093:0:17999:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.866230:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681314432 00000100:00100000:0.0:1788201420.866235:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681314432 00000100:00100000:0.0:1788201420.866266:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201420.866272:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17999:x1875064681314432:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788201420.866309:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17999:x1875064681314432:12345-0@lo:900:lod0001_rec0000.0 Request processed in 37us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.866315:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788201420.866341:0:17999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cdf837a5c00 x1875064681314432/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201420.866352:0:17999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17999:1875064681314432:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788201420.866387:0:17999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1875064681314560:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201420.866425:0:17999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201420.866443:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681314560 00000100:00100000:0.0:1788201420.866447:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681314560 00000100:00100000:0.0:1788201420.866466:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201420.866471:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17999:x1875064681314560:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201420.866511:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17999:x1875064681314560:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 40us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.866518:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201420.866532:0:17999:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.866544:0:17999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1875064681314560:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788201420.866578:0:17999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201420.872553:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201420.872641:0:17999:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788201420.872647:0:17999:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00000080:3.0:1788201420.875657:0:17972:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788201420.875735:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788201420.875845:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201420.876868:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788201420.877396:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788201420.877429:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788201420.877590:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788201420.878100:0:17972:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1788201420.885321:0:17972:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788201420.889099:0:17972:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788201420.889139:0:17972:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc15181c4b988 00100000:10000000:0.0:1788201420.889160:0:17972:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788201420.890313:0:17972:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201420.890340:0:17972:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201420.890356:0:17972:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788201420.890372:0:17972:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788201420.894833:0:17972:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201420.895108:0:17972:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788201421.246228:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:2.0:1788201421.690473:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201421.880150:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788201422.201617:0:17237:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201422.201623:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b3251800 from 8 10000000:01000000:2.0:1788201422.201628:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201422.201666:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.201678:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.201690:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.203530:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681314688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.203601:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.203658:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201422.203793:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681314688 00000100:00100000:0.0:1788201422.203801:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681314688 00000100:00100000:0.0:1788201422.203849:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201422.203859:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:17237:x1875064681314688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201422.203882:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201422.203900:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721554 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.203927:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721554 expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204014:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721554 expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204024:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367da00, rc 0) 00000100:00100000:0.0:1788201422.204062:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681314688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201422.204068:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201422.205573:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681314688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201422.205596:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.205607:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.205677:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681314816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.205735:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.206611:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681314816 00000100:00100000:3.0:1788201422.206619:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681314816 00000100:00100000:3.0:1788201422.206674:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788201422.206685:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681314816:12345-0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.207890:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990c00 going to sleep for 11 seconds 20000000:01000000:3.0:1788201422.208198:0:17235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201422.208218:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201422.208221:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788201422.208585:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681314816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1900us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.208595:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201422.208694:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681314816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201422.208931:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201422.208940:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.208950:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201422.208960:0:17237:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201422.208962:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0ba1d3800 from 8 10000000:01000000:2.0:1788201422.208965:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201422.208990:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.208997:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.209128:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.209158:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681314944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.209260:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.209339:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201422.209400:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681314944 00000100:00100000:3.0:1788201422.209407:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681314944 00000100:00100000:3.0:1788201422.209451:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201422.209460:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681314944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201422.209472:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201422.209484:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721562 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.209517:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721562 expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.209527:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721562 expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.209536:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bac00, rc 0) 00000100:00100000:3.0:1788201422.209576:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17237:x1875064681314944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.209583:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201422.209969:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681314944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201422.209990:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.210000:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.210118:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681315072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.210509:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.210542:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201422.211029:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681315072 00000100:00100000:3.0:1788201422.211036:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681315072 00000100:00100000:3.0:1788201422.211073:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201422.211081:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17237:x1875064681315072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201422.211098:0:17235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201422.211112:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201422.211114:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788201422.211226:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17237:x1875064681315072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.211234:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201422.211294:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681315072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201422.211341:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201422.211349:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.211358:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201422.262167:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:1.0:1788201422.712172:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201422.902404:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788201423.286813:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:0.0:1788201423.735031:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201424.310072:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00010000:00010000:1.0:1788201424.758939:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201425.336727:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 0 seconds 00000001:02000400:0.0:1788201425.583278:0:18242:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788201425.782527:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201426.037891:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201426.037922:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681315200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201426.038008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201426.038076:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681315200 00000100:00100000:1.0:1788201426.038083:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681315200 00000100:00100000:1.0:1788201426.038136:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201426.038146:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681315200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201426.038180:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788201426.038227:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681315200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201426.038232:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201426.038274:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681315200:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788201426.038863:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201426.038868:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201426.038876:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201426.038883:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b94fb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201426.039025:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201426.039037:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681315328:0@lo:400:kworker.0 00000100:00100000:2.0:1788201426.039078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201426.039227:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6aa300 x1875064681315456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201426.039251:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201426.039255:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201426.039258:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201426.039261:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201426.039281:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201426.039284:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201426.039287:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201426.039298:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201426.039325:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201426.039333:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681315712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201426.039365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201426.039396:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681315712 00000100:00100000:1.0:1788201426.039401:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681315712 00000100:00100000:1.0:1788201426.039434:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201426.039443:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681315712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201426.039485:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681315712:12345-0@lo:400:kworker.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201426.039491:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788201426.039523:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf6aad80 x1875064681315712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201426.039533:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681315712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201426.039551:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681315584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201426.039573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201426.039598:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681315584 00000100:00100000:1.0:1788201426.039602:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681315584 00000100:00100000:1.0:1788201426.039624:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201426.039631:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681315584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201426.039666:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681315584:12345-0@lo:400:kworker.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201426.039672:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788201426.039698:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf6a9f80 x1875064681315584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201426.039720:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681315584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201426.040787:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681315328 00000100:00100000:3.0:1788201426.040798:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681315328 00000100:00100000:3.0:1788201426.040847:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201426.040857:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:3645:x1875064681315328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201426.040930:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:3645:x1875064681315328:12345-0@lo:400:kworker.0 Request processed in 75us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201426.040936:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201426.040988:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681315328:0@lo:400:kworker.0 00000100:00100000:2.0:1788201426.041361:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681315456:0@lo:38:kworker.0 00000100:00100000:2.0:1788201426.041396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201426.041575:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681315456 00000100:00100000:1.0:1788201426.041580:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681315456 00000100:00100000:1.0:1788201426.041601:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201426.041607:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681315456:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201426.041634:0:17245:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:1.0:1788201426.041664:0:17245:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44721570 00000004:00100000:1.0:1788201426.041680:0:17245:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788201426.041685:0:17245:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788201426.056698:0:17245:0:(import.c:65:import_set_state_nolock()) ffff9ce0849b9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201426.056847:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681315456:12345-0@lo:38:kworker.0 Request processed in 15238us (15448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201426.056858:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788201426.056971:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788201426.056980:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788201426.056985:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788201426.056988:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788201426.057015:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000061fdbb5f): req@ffff9ce0bf6aa680 x1875064681308288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201426.057038:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681315456:0@lo:38:kworker.0 00000100:00100000:0.0:1788201426.057213:0:17282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201426.057242:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201426.057291:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681308288 00000100:00100000:1.0:1788201426.057297:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681308288 00000100:00100000:1.0:1788201426.057340:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201426.057349:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17282:x1875064681308288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201426.057421:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17282:x1875064681308288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201426.057427:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201426.057486:0:17282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17282:1875064681308288:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788201426.057522:0:17282:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788201426.057560:0:17282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17282:1875064681315840:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201426.057590:0:17282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201426.057620:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201426.057632:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681315840 00000100:00100000:0.0:1788201426.057635:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681315840 00000100:00100000:0.0:1788201426.057653:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201426.057660:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17282:x1875064681315840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201426.057770:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17282:x1875064681315840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 110us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201426.057777:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201426.057804:0:17282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17282:1875064681315840:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201426.057863:0:17282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17282:1875064681315968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201426.057886:0:17282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201426.057901:0:17282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0945740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201426.057918:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681315968 00000100:00100000:0.0:1788201426.057922:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681315968 00000100:00100000:0.0:1788201426.057939:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201426.057944:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17282:x1875064681315968:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201426.057992:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17282:x1875064681315968:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201426.057998:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201426.058853:0:17282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17282:1875064681315968:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788201426.058919:0:17282:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201426.060825:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681316096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201426.061218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201426.061317:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681316096 00000100:00100000:3.0:1788201426.061325:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681316096 00000100:00100000:3.0:1788201426.061370:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201426.061379:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681316096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201426.061411:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788201426.061458:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681316096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201426.061465:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201426.061610:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681316096:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788201426.065639:0:17282:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201426.065721:0:17282:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1788201426.065755:0:17282:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788201426.490297:0:18295:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201426.490520:0:18295:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201426.806706:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201427.427922:0:18345:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201427.428127:0:18345:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201427.833961:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201428.342698:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788201428.420952:0:18393:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecbc615d0 20000000:00000080:1.0:1788201428.420971:0:18393:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce0bb64d000 uarg=0000000000000000 20000000:01000000:1.0:1788201428.421088:0:18393:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788201428.421106:0:18393:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788201428.421111:0:18393:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788201428.422111:0:18394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788201428.422319:0:18393:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788201428.429257:0:18393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788201428.429305:0:18393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.429324:0:18393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721419 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.429331:0:18393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472151c expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.429338:0:18393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.429381:0:18393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472151c expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.429396:0:18393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472151c expref: 17 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201428.429410:0:18393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18393:1875064681316224:0@lo:104: 00000100:00100000:2.0:1788201428.429474:0:18393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201428.429567:0:18393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721419 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.429576:0:18393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721419 expref: 17 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201428.429584:0:18393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18393:1875064681316352:0@lo:104: 00000100:00100000:2.0:1788201428.429605:0:18393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201428.430126:0:18393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201428.432155:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681316224 00000100:00100000:3.0:1788201428.432168:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681316224 00000100:00100000:1.0:1788201428.432253:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681316352 00000100:00100000:1.0:1788201428.432257:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681316352 00000100:00100000:1.0:1788201428.432284:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201428.432293:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:18393:x1875064681316224:12345-0@lo:104: 00010000:00010000:1.0:1788201428.432310:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432404:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201428.432411:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:18393:x1875064681316224:12345-0@lo:104: Request processed in 120us (2936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.432418:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201428.432435:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201428.432441:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:18393:x1875064681316352:12345-0@lo:104: 00010000:00010000:1.0:1788201428.432449:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432496:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201428.432501:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:18393:x1875064681316352:12345-0@lo:104: Request processed in 62us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.432508:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788201428.432524:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201428.432530:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432537:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbe00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201428.432542:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432550:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201428.432557:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201428.432563:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201428.432595:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432602:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201428.432621:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432628:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbe00/0xf9b71aee4472151c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721523 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432650:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201428.432654:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432660:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201428.432663:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432670:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201428.432677:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201428.432682:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201428.432696:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432702:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201428.432708:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432714:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83254200/0xf9b71aee44721419 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721420 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.432726:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201428.432728:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201428.432729:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201428.432861:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201428.432957:0:18393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18393:1875064681316224:0@lo:104: 00000100:00100000:2.0:1788201428.432968:0:18393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18393:1875064681316352:0@lo:104: 00010000:00010000:2.0:1788201428.432994:0:18393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.433062:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681316480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201428.433115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201428.433155:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201428.433161:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681316608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201428.433181:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201428.433350:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681316480 00000100:00100000:2.0:1788201428.433355:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681316480 00010000:00010000:2.0:1788201428.433377:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472151c expref: 18 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201428.433405:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681316608 00000100:00100000:2.0:1788201428.433408:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681316608 00010000:00010000:2.0:1788201428.433419:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721419 expref: 19 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201428.433431:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201428.433438:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:3644:x1875064681316480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201428.433450:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201428.433455:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472151c expref: 19 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433465:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472151c expref: 19 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433480:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721523 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472151c expref: 19 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433493:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201428.433522:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:3644:x1875064681316480:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201428.433528:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201428.433541:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201428.433557:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:3644:x1875064681316608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201428.433566:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201428.433570:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721419 expref: 17 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433579:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721419 expref: 17 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433589:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1c00/0xf9b71aee44721420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721419 expref: 17 pid: 17233 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433600:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433608:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433622:0:17225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433628:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433634:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433639:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433645:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201428.433648:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433661:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433676:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433686:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201428.433709:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:3644:x1875064681316608:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201428.433716:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788201428.433760:0:18393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433768:0:18393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.433775:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0200/0xf9b71aee44721577 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.434707:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681316608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201428.434719:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681316480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201428.855907:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201429.877966:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201430.133853:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201420/real 1788201420] req@ffff9ce0bf6a8700 x1875064681311616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201430 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201430.133885:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf6a8700 x1875064681311616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201430 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201430.133905:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201420/real 1788201420] req@ffff9cdf8410d500 x1875064681311360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201430 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201430.133917:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cdf8410d500 x1875064681311360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201430 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201430.133936:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201430.133959:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201430.133963:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681311616:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788201430.133969:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a026b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201430.133974:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201430.133977:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681311360:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788201430.134120:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201430.134125:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201430.134128:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201430.134131:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201430.134158:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201430.134161:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201430.134164:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0a026b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201430.134169:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1788201430.134174:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201430.134181:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce0a026b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201430.134201:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8410ca80 x1875064681317248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201430.134212:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201430.134215:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201430.134229:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201430.134233:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1788201430.134235:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201430.134239:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce0bf443000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201430.134252:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8410c700 x1875064681317376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201430.134282:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681316992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.134341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.134382:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201430.134388:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681317120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.134414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.134447:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681317120 00000100:00100000:3.0:1788201430.134455:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681317120 00000100:00100000:3.0:1788201430.134497:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201430.134506:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681317120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.134557:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681317120:12345-0@lo:400:kworker.0 Request processed in 52us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.134564:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201430.134601:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681317120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.134729:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681316736:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.134795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201430.134819:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681317504:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.134838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201430.134854:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201430.134867:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681316864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.134889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.134998:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681316736 00000100:00100000:3.0:1788201430.135002:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681316736 00000100:00100000:3.0:1788201430.135036:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201430.135043:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:3646:x1875064681316736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.135090:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:3646:x1875064681316736:12345-0@lo:400:kworker.0 Request processed in 38us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.135096:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201430.135129:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681316864 00000100:00100000:3.0:1788201430.135132:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681316864 00000100:00100000:3.0:1788201430.135152:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201430.135158:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681316864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.135186:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681316864:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.135192:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201430.135218:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681316864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.135226:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681316736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201430.135299:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681316992 00000100:00100000:1.0:1788201430.135303:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681316992 00000100:00100000:1.0:1788201430.135336:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681317504 00000100:00100000:1.0:1788201430.135339:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681317504 00000100:00100000:1.0:1788201430.135354:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201430.135361:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681316992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201430.135401:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681316992:12345-0@lo:400:kworker.0 Request processed in 40us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201430.135407:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201430.135419:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201430.135425:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681317504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201430.135467:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681317504:12345-0@lo:400:kworker.0 Request processed in 42us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201430.135473:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201430.135495:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681317248:0@lo:8:kworker.0 00000400:00000100:1.0:1788201430.135520:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681317248 offset 0 length 520: 4 00000100:00100000:1.0:1788201430.135538:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681317376:0@lo:8:kworker.0 00000400:00000100:1.0:1788201430.135556:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681317376 offset 0 length 520: 4 00010000:00080000:1.0:1788201430.135588:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cdf8410dc00 x1875064681316992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201430.135598:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681316992:0@lo:400:kworker.0 00010000:00080000:1.0:1788201430.135618:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cdf8410f480 x1875064681317504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201430.135626:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681317504:0@lo:400:kworker.0 10000000:01000000:2.0:1788201430.136115:0:17237:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201430.136120:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b3251800 from 13 10000000:01000000:2.0:1788201430.136123:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201430.136157:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201430.136166:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201430.136176:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201430.136205:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681317632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201430.136237:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201430.136273:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201430.136332:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681317632 00000100:00100000:1.0:1788201430.136336:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681317632 00000100:00100000:1.0:1788201430.136403:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201430.136411:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+16:17237:x1875064681317632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201430.136422:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201430.136436:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472157e expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201430.136457:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472157e expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201430.136468:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472157e expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201430.136483:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201430.136524:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681317632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201430.136530:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201430.136594:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681317632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201430.136607:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201430.136615:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201430.136671:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681317760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201430.136695:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201430.137567:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201430.137678:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681317760 00000100:00100000:3.0:1788201430.137684:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681317760 00000100:00100000:3.0:1788201430.137716:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201430.137723:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681317760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201430.137872:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681317760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.137880:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201430.138055:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681317760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201430.138097:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681317888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201430.138144:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201430.138172:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201430.138273:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681317888 00000100:00100000:3.0:1788201430.138277:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681317888 00000100:00100000:3.0:1788201430.138297:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201430.138303:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681317888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201430.138388:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681317888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.138395:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201430.138471:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681317888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201430.139396:0:18461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788201430.139550:0:17237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788201430.139573:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201430.139582:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201430.139600:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201430.139611:0:17237:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201430.139613:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0ba1d3800 from 13 10000000:01000000:3.0:1788201430.139616:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201430.139643:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201430.139651:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201430.139660:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201430.139678:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681318016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201430.139716:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.139771:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201430.139848:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681318016 00000100:00100000:2.0:1788201430.139853:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681318016 00000100:00100000:2.0:1788201430.139878:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201430.139886:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+17:17237:x1875064681318016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201430.140001:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201430.140020:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472158c expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201430.140115:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472158c expref: 18 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201430.140126:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472158c expref: 18 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201430.140134:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1400, rc 0) 00000100:00100000:2.0:1788201430.140219:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17237:x1875064681318016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 333us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201430.140226:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201430.140397:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681318016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201430.140412:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201430.140421:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201430.140469:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681318144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201430.140495:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.140562:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201430.140599:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681318144 00000100:00100000:2.0:1788201430.140604:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681318144 00000100:00100000:2.0:1788201430.140668:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788201430.140675:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17237:x1875064681318144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201430.140808:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17237:x1875064681318144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201430.140815:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201430.140909:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681318144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201430.140939:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681318272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201430.140976:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.141169:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201430.141234:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681318272 00000100:00100000:1.0:1788201430.141239:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681318272 00000100:00100000:1.0:1788201430.141262:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201430.141268:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17237:x1875064681318272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201430.141351:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:17237:x1875064681318272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201430.141358:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201430.141437:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681318272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201430.142373:0:18462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788201430.142523:0:17237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788201430.142547:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201430.142556:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201430.142565:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201430.906951:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201431.158878:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201431.158899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681318400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201431.158949:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201416/real 1788201416] req@ffff9ce0bf4e9500 x1875064681309312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201431 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201431.158969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201431.158976:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf4e9500 x1875064681309312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201431 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201431.158986:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201416/real 1788201416] req@ffff9ce0bf4e8380 x1875064681309440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201431 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201431.158999:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf4e8380 x1875064681309440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201431 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201431.159019:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681318400 00000100:00080000:2.0:1788201431.159025:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788201431.159028:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681318400 00000100:00080000:2.0:1788201431.159044:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201431.159049:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681309312:0@lo:8:kworker.0 00000100:00080000:2.0:1788201431.159055:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201431.159062:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201431.159065:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681309440:0@lo:8:kworker.0 00000100:00100000:1.0:1788201431.159089:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201431.159100:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681318400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201431.159139:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788201431.159193:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681318400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201431.159199:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788201431.159255:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201431.159259:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201431.159261:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201431.159266:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1788201431.159270:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201431.159274:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cdf821da800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201431.159294:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8000 x1875064681318784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201431.159307:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201431.159310:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788201431.159312:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201431.159315:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1788201431.159317:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201431.159320:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce083419000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201431.159329:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8380 x1875064681318912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201431.159346:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201431.159348:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201431.159351:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201431.159353:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201431.159382:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681318528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201431.159412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201431.159438:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201431.159444:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681318656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201431.159465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201431.159493:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681318528 00000100:00100000:1.0:1788201431.159497:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681318528 00000100:00100000:1.0:1788201431.159523:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201431.159530:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:3644:x1875064681318528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201431.159565:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:3644:x1875064681318528:12345-0@lo:400:kworker.0 Request processed in 35us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201431.159571:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201431.159610:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681318528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201431.159629:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681318784:0@lo:8:kworker.0 00000400:00000100:1.0:1788201431.159648:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681318784 offset 0 length 520: 4 00000100:00100000:1.0:1788201431.159659:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681318912:0@lo:8:kworker.0 00000400:00000100:1.0:1788201431.159673:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681318912 offset 0 length 520: 4 00000100:00100000:1.0:1788201431.159688:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681318656 00000100:00100000:1.0:1788201431.159691:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681318656 00000100:00100000:1.0:1788201431.159710:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201431.159716:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681318656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201431.159770:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681318656:12345-0@lo:400:kworker.0 Request processed in 53us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201431.159776:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201431.159802:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681318656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201431.159878:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681319168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201431.159908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201431.159934:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201431.159939:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681319040:0@lo:400:kworker.0 00000100:00100000:3.0:1788201431.159959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201431.159985:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681319168 00000100:00100000:3.0:1788201431.159988:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681319168 00000100:00100000:3.0:1788201431.160014:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681319040 00000100:00100000:3.0:1788201431.160017:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681319040 00000100:00100000:3.0:1788201431.160030:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201431.160036:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681319168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201431.160081:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681319168:12345-0@lo:400:kworker.0 Request processed in 35us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201431.160088:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201431.160099:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201431.160104:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681319040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201431.160126:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681319040:12345-0@lo:400:kworker.0 Request processed in 22us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201431.160131:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788201431.160163:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf6a8e00 x1875064681319040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201431.160173:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681319040:0@lo:400:kworker.0 00010000:00080000:3.0:1788201431.160181:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf6aa300 x1875064681319168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201431.160189:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681319168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201431.160237:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681318400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201431.166768:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681319296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201431.166836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201431.166935:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681319296 00000100:00100000:3.0:1788201431.166943:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681319296 00000100:00100000:3.0:1788201431.166990:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201431.166998:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681319296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201431.167031:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788201431.167086:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681319296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201431.167094:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201431.167136:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681319296:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788201431.685686:0:17973:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788201431.926415:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201432.119016:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788201432.958469:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201433.978368:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201434.931415:0:18741:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201434.931419:0:18741:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788201434.931421:0:18741:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788201434.931536:0:18741:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ce0a02eb000 00000020:01000004:3.0:1788201434.931551:0:18741:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788201434.931564:0:18741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788201434.931577:0:18741:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cdf821d0000) 00000020:00000080:3.0:1788201434.931593:0:18741:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788201434.999327:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788201435.036825:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788201435.038858:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788201435.039359:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788201435.039952:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788201435.040448:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788201435.040870:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788201435.041142:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788201435.043988:0:18741:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788201435.044262:0:18741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788201435.044276:0:18741:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201435.044288:0:18741:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf9b71aee447215a1 00000020:01000004:2.0:1788201435.044296:0:18741:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788201435.044318:0:18741:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788201435.044322:0:18741:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788201435.044327:0:18741:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788201435.044332:0:18741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788201435.044344:0:18741:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ce0b2520000) 00000020:00000080:2.0:1788201435.044355:0:18741:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788201435.050033:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201435.054184:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201435.054194:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788201435.057889:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201435.057903:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788201435.058644:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201435.058652:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788201435.061287:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201435.061485:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788201435.061493:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788201435.065007:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788201435.065022:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788201435.119173:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201435.119422:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201435.119429:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788201435.125378:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788201435.125398:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788201435.130889:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201435.130909:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788201435.137651:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201435.138482:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788201435.138492:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788201435.141005:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788201435.141022:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788201435.199345:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201435.199595:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788201435.199603:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788201435.200726:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788201435.200762:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788201435.201700:0:18741:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788201435.201730:0:18741:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788201435.201890:0:18741:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788201435.213660:0:18741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201435.213702:0:18741:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788201435.213706:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201435.213709:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201435.213710:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201435.213711:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201435.213712:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201435.213714:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201435.213715:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201435.213717:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201435.213719:0:18741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201435.213722:0:18741:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788201435.213725:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201435.213726:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201435.213728:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201435.213729:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201435.213730:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201435.213731:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201435.213732:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201435.213733:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201435.213734:0:18741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201435.213813:0:18741:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788201435.213834:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319424:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201435.213925:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201435.213966:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf82494c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201435.214083:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681319424 00000100:00100000:0.0:1788201435.214091:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681319424 00000100:00100000:0.0:1788201435.214148:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201435.214157:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:18741:x1875064681319424:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201435.214196:0:17233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201435.214199:0:17233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788201435.214203:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201435.214498:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:18741:x1875064681319424:12345-0@lo:253:mount.lustre.0 Request processed in 341us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.214506:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201435.214997:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319424:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201435.215010:0:18741:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788201435.215012:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201435.215014:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201435.215015:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201435.215016:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201435.215017:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201435.215018:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201435.215019:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201435.215021:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201435.215022:0:18741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201435.215062:0:18741:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0a02eb000 from lustre-OST0000 10000000:01000000:2.0:1788201435.215101:0:18741:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788201435.215104:0:18741:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201435.215112:0:18741:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0b9700000 local copy 00010000:00010000:2.0:1788201435.215120:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201435.215216:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201435.215251:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201435.215290:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf824940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201435.215359:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681319552 00000100:00100000:1.0:1788201435.215364:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681319552 00000100:00100000:1.0:1788201435.215404:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201435.215413:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:18741:x1875064681319552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201435.215495:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:18741:x1875064681319552:12345-0@lo:501:mount.lustre.0 Request processed in 83us (242us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201435.215508:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201435.216120:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319552:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788201435.216136:0:18741:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788201435.216161:0:18741:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788201435.216168:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.216178:0:18741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201435.216206:0:18741:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0a02eb000 10000000:01000000:3.0:1788201435.216211:0:18741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201435.216216:0:18741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201435.216219:0:18741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201435.216223:0:18741:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788201435.216226:0:18741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201435.216248:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.216256:0:18741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.216267:0:18741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201435.216282:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201435.216316:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.216352:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201435.219299:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681319680 00000100:00100000:0.0:1788201435.219314:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681319680 00000100:00100000:0.0:1788201435.219378:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201435.219387:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+18:18741:x1875064681319680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201435.219405:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201435.219423:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367cc00/0xf9b71aee447215b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447215af expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.219452:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367cc00/0xf9b71aee447215b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447215af expref: 19 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.219478:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367cc00/0xf9b71aee447215b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447215af expref: 19 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.219488:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367cc00, rc 0) 00000100:00100000:0.0:1788201435.219575:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681319680:12345-0@lo:101:mount.lustre.0 Request processed in 189us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.219582:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201435.220436:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201435.220468:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.220478:0:18741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201435.221918:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788201435.222940:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201435.226385:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788201435.226434:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788201435.226442:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788201435.226450:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788201435.226457:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788201435.226463:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788201435.226483:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788201435.226488:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788201435.226600:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201435.226677:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.226822:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201435.227099:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681319808 00000100:00100000:0.0:1788201435.227107:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681319808 00000100:00100000:0.0:1788201435.227378:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201435.227391:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681319808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201435.227587:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681319808:12345-0@lo:501:mount.lustre.0 Request processed in 198us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.227598:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201435.227655:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201435.227689:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201435.227734:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201435.228014:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681319936 00000100:00100000:3.0:1788201435.228019:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201435.228022:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681319936 00000100:00100000:2.0:1788201435.228072:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201435.228081:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681319936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201435.229486:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681319936:12345-0@lo:503:mount.lustre.0 Request processed in 1400us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.229497:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201435.230120:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681319936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201435.233366:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201435.233483:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.233571:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.233689:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201435.236198:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681320064 00000100:00100000:0.0:1788201435.236212:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681320064 00000100:00100000:0.0:1788201435.236304:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201435.236315:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681320064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201435.236932:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681320064:12345-0@lo:502:mount.lustre.0 Request processed in 616us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.236941:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788201435.236953:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201435.237193:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788201435.237224:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788201435.237240:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788201435.237253:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788201435.237395:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788201435.237415:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788201435.237430:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788201435.237445:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788201435.237462:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788201435.237496:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788201435.237514:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788201435.237528:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788201435.237566:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.237614:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.237657:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084ffe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201435.238382:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681320192 00000100:00100000:2.0:1788201435.238390:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681320192 00000100:00100000:2.0:1788201435.238493:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201435.238504:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681320192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201435.238637:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681320192:12345-0@lo:502:mount.lustre.0 Request processed in 135us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.238646:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788201435.238729:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201435.238805:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788201435.238817:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788201435.241989:0:18758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201435.242001:0:18758:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788201435.242008:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201435.242010:0:18758:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788201435.242017:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201435.242033:0:18758:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cdf821d4d40) 00000020:00000080:3.0:1788201435.242073:0:18758:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201435.242081:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201435.242153:0:18758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0a02eb000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788201435.242162:0:18758:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201435.242182:0:18758:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf9b71aee447215c4 00010000:00010000:3.0:1788201435.251308:0:18758:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788201435.252259:0:18758:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:3.0:1788201435.254868:0:18758:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788201435.269151:0:18758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788201435.269163:0:18758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201435.269170:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201435.269172:0:18758:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788201435.269175:0:18758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201435.269184:0:18758:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788201435.269186:0:18758:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201435.269188:0:18758:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201435.269189:0:18758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201435.269192:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201435.269194:0:18758:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201435.269196:0:18758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201435.269200:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201435.269202:0:18758:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201435.269205:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201435.269206:0:18758:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201435.269209:0:18758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201435.269211:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201435.269212:0:18758:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788201435.269214:0:18758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201435.269218:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201435.269220:0:18758:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201435.269224:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788201435.269257:0:18758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201435.269261:0:18758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201435.269263:0:18758:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788201435.269266:0:18758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788201435.269489:0:18741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788201435.269520:0:18741:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201435.269544:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.269556:0:18741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201435.269564:0:18741:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0a02eb000 from 1 10000000:01000000:3.0:1788201435.269567:0:18741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201435.269602:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.269610:0:18741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.269621:0:18741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201435.269646:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201435.269715:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.269794:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b9631d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201435.270080:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681320320 00000100:00100000:0.0:1788201435.270089:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681320320 00000100:00100000:0.0:1788201435.270180:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201435.270192:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:18741:x1875064681320320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201435.270208:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201435.270223:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447215cb expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.270248:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447215cb expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.270259:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447215cb expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.270277:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d600, rc 0) 00000100:00100000:0.0:1788201435.270336:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320320:12345-0@lo:101:mount.lustre.0 Request processed in 147us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.270343:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788201435.270427:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201435.270443:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.270463:0:18741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201435.284387:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788201435.284669:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201435.285073:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788201435.285100:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788201435.285117:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788201435.285122:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788201435.285201:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201435.285268:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.285318:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e81900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.287070:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681320448 00000100:00100000:3.0:1788201435.287083:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681320448 00000100:00100000:3.0:1788201435.287141:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201435.287151:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201435.287306:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320448:12345-0@lo:501:mount.lustre.0 Request processed in 156us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.287312:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201435.292487:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201435.292552:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201435.292641:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.292683:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce083e81900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.295623:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681320576 00000100:00100000:3.0:1788201435.295636:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681320576 00000100:00100000:3.0:1788201435.295696:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201435.295706:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201435.295883:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320576:12345-0@lo:503:mount.lustre.0 Request processed in 178us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.295890:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201435.295970:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201435.296430:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201435.296527:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201435.296580:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201435.296627:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.296692:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681320704 00000100:00100000:3.0:1788201435.296698:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681320704 00000100:00100000:3.0:1788201435.296732:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201435.296768:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.296875:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320704:12345-0@lo:502:mount.lustre.0 Request processed in 135us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.296883:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201435.298849:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201435.299128:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788201435.299158:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788201435.299182:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788201435.299196:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788201435.299209:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788201435.299220:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788201435.299233:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788201435.299245:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788201435.299258:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788201435.299356:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788201435.299369:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788201435.299519:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201435.299663:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201435.299790:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b311fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.299807:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681320832 00000100:00100000:3.0:1788201435.299823:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681320832 00000100:00100000:3.0:1788201435.299889:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788201435.299899:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.300027:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320832:12345-0@lo:502:mount.lustre.0 Request processed in 122us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.300032:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.300039:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000040:00080000:2.0:1788201435.300094:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788201435.300103:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788201435.302656:0:18762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201435.302670:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201435.302672:0:18762:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201435.302679:0:18762:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0a02eb000 00000020:00000080:2.0:1788201435.302682:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201435.302690:0:18762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201435.302693:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201435.302694:0:18762:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201435.302697:0:18762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201435.302700:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201435.302701:0:18762:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201435.302704:0:18762:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0a02eb000 00000020:00000080:2.0:1788201435.302706:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201435.303153:0:18762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201435.303159:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201435.303160:0:18762:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788201435.303163:0:18762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201435.303172:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201435.303173:0:18762:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201435.303177:0:18762:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0a02eb000 00000020:00000080:2.0:1788201435.303179:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201435.303200:0:18762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201435.303203:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201435.303205:0:18762:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201435.303208:0:18762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201435.303210:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201435.303211:0:18762:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788201435.303214:0:18762:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0a02eb000 00000020:00000080:2.0:1788201435.303217:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201435.303239:0:18762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201435.303243:0:18762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201435.303244:0:18762:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788201435.303248:0:18762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788201435.316615:0:18741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788201435.316661:0:18741:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201435.316687:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.316700:0:18741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201435.316793:0:18741:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201435.316796:0:18741:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0a02eb000 10000000:01000000:3.0:1788201435.316800:0:18741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0a02eb000 10000000:01000000:3.0:1788201435.316804:0:18741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201435.316809:0:18741:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0a02eb000 from 1 10000000:01000000:3.0:1788201435.316812:0:18741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201435.316847:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.316855:0:18741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.316866:0:18741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201435.316891:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201435.316969:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.317004:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0862cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201435.317125:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681320960 00000100:00100000:2.0:1788201435.317132:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681320960 00000100:00100000:2.0:1788201435.317172:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788201435.317181:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:18741:x1875064681320960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201435.317195:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201435.317208:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0200/0xf9b71aee447215e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447215d9 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201435.317231:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0200/0xf9b71aee447215e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447215d9 expref: 21 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201435.317242:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0200/0xf9b71aee447215e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447215d9 expref: 21 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201435.317251:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0200, rc 0) 00000100:00100000:2.0:1788201435.317298:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681320960:12345-0@lo:101:mount.lustre.0 Request processed in 118us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.317305:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201435.317464:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681320960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201435.317479:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.317488:0:18741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201435.328469:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788201435.328823:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201435.329022:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788201435.329060:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788201435.329076:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788201435.329091:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788201435.329103:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788201435.329115:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788201435.329128:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788201435.329143:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788201435.329153:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788201435.329164:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788201435.329192:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788201435.329207:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788201435.329221:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788201435.329234:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788201435.329246:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788201435.329259:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788201435.329271:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788201435.329284:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788201435.329296:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788201435.329308:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788201435.329331:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788201435.329344:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788201435.329357:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788201435.329370:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788201435.329382:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788201435.329396:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788201435.329424:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788201435.329439:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788201435.329451:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788201435.329463:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788201435.329474:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788201435.329485:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788201435.329496:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788201435.329507:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788201435.329520:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788201435.329533:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788201435.329546:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788201435.329566:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788201435.329572:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788201435.329651:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201435.329715:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.329788:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0862cf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201435.336112:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681321088 00000100:00100000:2.0:1788201435.336126:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681321088 00000100:00100000:2.0:1788201435.336193:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201435.336202:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201435.336371:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321088:12345-0@lo:501:mount.lustre.0 Request processed in 170us (6655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.336379:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201435.336526:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201435.336578:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201435.336629:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.336660:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0862cf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.336675:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681321216 00000100:00100000:3.0:1788201435.336679:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681321216 00000100:00100000:3.0:1788201435.336703:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201435.336711:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201435.336834:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321216:12345-0@lo:503:mount.lustre.0 Request processed in 123us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.336842:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201435.336881:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321216:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201435.337282:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201435.337348:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.337387:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.337405:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.337422:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681321344 00000100:00100000:3.0:1788201435.337426:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681321344 00000100:00100000:3.0:1788201435.337454:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201435.337461:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.337551:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321344:12345-0@lo:502:mount.lustre.0 Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.337558:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201435.337605:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201435.337803:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788201435.337830:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788201435.337846:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788201435.337860:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788201435.337875:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788201435.337890:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788201435.337906:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788201435.337920:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788201435.337934:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788201435.337948:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788201435.337963:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788201435.337987:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788201435.338001:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788201435.338016:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788201435.338030:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788201435.338058:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788201435.338075:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788201435.338085:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788201435.338110:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788201435.338125:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788201435.338138:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788201435.338151:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788201435.338163:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788201435.338175:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788201435.338187:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788201435.338198:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788201435.338210:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788201435.338221:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788201435.338233:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788201435.338245:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788201435.338258:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788201435.338271:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788201435.338284:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788201435.338297:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788201435.338324:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788201435.338340:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788201435.338355:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788201435.338368:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788201435.338380:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788201435.338392:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788201435.338404:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788201435.338415:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788201435.338427:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788201435.338438:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788201435.338464:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788201435.338475:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788201435.338487:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788201435.338498:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788201435.338534:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.338578:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.338617:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681321472 00000100:00100000:3.0:1788201435.338622:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681321472 00000100:00100000:3.0:1788201435.338664:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201435.338671:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.338777:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321472:12345-0@lo:502:mount.lustre.0 Request processed in 105us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.338785:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201435.338822:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.338838:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201435.338976:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788201435.338999:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788201435.339019:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.339064:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.339085:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681321600 00000100:00100000:3.0:1788201435.339089:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681321600 00000100:00100000:3.0:1788201435.339111:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201435.339118:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201435.339176:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681321600:12345-0@lo:502:mount.lustre.0 Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.339183:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201435.339212:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.339230:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681321600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201435.339263:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788201435.339270:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788201435.352585:0:18767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788201435.352603:0:18767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ce0b25219c0) 00000020:00000080:2.0:1788201435.352630:0:18767:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788201435.352814:0:18767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0a02eb000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201435.352819:0:18767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0a02eb000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201435.352821:0:18767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0a02eb000 3 00010000:00080000:2.0:1788201435.352849:0:18767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf81986800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1788201435.354441:0:18767:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788201435.354560:0:18767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788201435.354603:0:18767:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788201435.354615:0:18767:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf9b71aee447215ee 00000100:00080000:2.0:1788201435.354625:0:18767:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201435.354631:0:18767:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cdf81986800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201435.354668:0:18767:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf837a7480 x1875064681321728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201435.354700:0:18767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201435.356929:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201435.356936:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201435.356939:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201435.356942:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201435.356971:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201435.356974:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201435.356976:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201435.356979:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201435.357022:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681322240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.357138:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201435.357144:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681321856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.357203:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681321984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.357246:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201435.357252:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681322112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.357311:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681322240 00000100:00100000:3.0:1788201435.357318:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681322240 00000100:00100000:3.0:1788201435.357354:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681321984 00000100:00100000:3.0:1788201435.357371:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681321984 00000100:00100000:3.0:1788201435.357391:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201435.357398:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681322240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357447:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681322240:12345-0@lo:400:kworker.0 Request processed in 49us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.357454:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201435.357468:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201435.357474:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681321984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357503:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681321984:12345-0@lo:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.357509:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201435.357530:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681321856 00000100:00100000:3.0:1788201435.357533:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681321856 00000100:00100000:3.0:1788201435.357547:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681322112 00000100:00100000:3.0:1788201435.357550:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681322112 00000100:00100000:3.0:1788201435.357561:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201435.357567:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681321856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357596:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681321856:12345-0@lo:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.357602:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201435.357611:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201435.357617:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681322112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357641:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681322112:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.357646:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201435.357680:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681322112:0@lo:400:kworker.0 00010000:00080000:3.0:1788201435.357704:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cdf8410f800 x1875064681321984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201435.357715:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681321984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.357776:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681321856:0@lo:400:kworker.0 00010000:00080000:3.0:1788201435.357786:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cdf8410dc00 x1875064681322240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201435.357794:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681322240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.359375:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681321728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201435.359440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788201435.360134:0:18767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788201435.360150:0:18767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ce0b2524d40) 00000020:00000080:2.0:1788201435.360184:0:18767:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788201435.360334:0:18767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0a02eb000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201435.360338:0:18767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0a02eb000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201435.360340:0:18767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0a02eb000 3 00010000:00080000:2.0:1788201435.360365:0:18767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf81987800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.102@tcp at head 00000100:00100000:0.0:1788201435.365457:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681321728 00000100:00100000:0.0:1788201435.365473:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681321728 00000100:00100000:0.0:1788201435.365520:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201435.365528:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875064681321728:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201435.365555:0:17241:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1788201435.365591:0:17241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf9b71aee447215fc 00000004:00100000:0.0:1788201435.365613:0:17241:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201435.365645:0:17241:0:(import.c:65:import_set_state_nolock()) ffff9ce0849be000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201435.365726:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875064681321728:12345-0@lo:38:llog_process_th.0 Request processed in 197us (6285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.365733:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788201435.367490:0:18767:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788201435.367598:0:18767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788201435.367644:0:18767:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788201435.367657:0:18767:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf9b71aee44721603 00000100:00080000:2.0:1788201435.367668:0:18767:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201435.367674:0:18767:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cdf81987800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201435.367706:0:18767:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf837a4000 x1875064681322368/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201435.367723:0:18767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788201435.371937:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681322368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201435.372021:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788201435.372099:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cdf837a7480 x1875064681321728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201435.372109:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201435.372118:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788201435.372126:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201435.372130:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201435.372134:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf81986800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201435.372140:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681321728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201435.372173:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681322368 00000100:00100000:0.0:1788201435.372179:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681322368 00000100:00100000:0.0:1788201435.372199:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201435.372205:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681322368:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201435.372231:0:17240:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1788201435.372262:0:17240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf9b71aee4472160a 00000004:00100000:0.0:1788201435.372275:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201435.372303:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9ce0849bd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201435.372347:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875064681322368:12345-0@lo:38:llog_process_th.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.372362:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788201435.372389:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cdf837a4000 x1875064681322368/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201435.372397:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201435.372401:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788201435.372406:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201435.372409:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788201435.372411:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf81987800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201435.372415:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681322368:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788201435.372615:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201435.372620:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201435.372623:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201435.372626:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201435.372629:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201435.372632:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201435.372634:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201435.372636:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788201435.378364:0:18767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788201435.382195:0:18741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788201435.382240:0:18741:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201435.382258:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201435.382271:0:18741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201435.382500:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201435.382503:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201435.382504:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201435.382505:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201435.382507:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201435.382508:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201435.382510:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201435.382512:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201435.382513:0:18741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201435.382517:0:18741:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788201435.382520:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201435.382521:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201435.382522:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201435.382523:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201435.382525:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201435.382526:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201435.382527:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201435.382528:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201435.382529:0:18741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201435.382555:0:18741:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788201435.382575:0:18741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681322496:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201435.382643:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.382729:0:18741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823a2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201435.384542:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681322496 00000100:00100000:3.0:1788201435.384553:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681322496 00000100:00100000:2.0:1788201435.384660:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201435.384670:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681322496:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201435.384716:0:17235:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788201435.384730:0:17235:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201435.398229:0:17235:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201435.398252:0:17235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788201435.398557:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:18741:x1875064681322496:12345-0@lo:253:mount.lustre.0 Request processed in 13884us (15909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.398570:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201435.398667:0:18741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:18741:1875064681322496:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201435.398681:0:18741:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788201435.398684:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201435.398686:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201435.398687:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201435.398688:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201435.398690:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201435.398691:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201435.398692:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201435.398695:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201435.398696:0:18741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788201435.398715:0:18741:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788201435.403104:0:18741:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 20000000:01000000:3.0:1788201435.404575:0:17256:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201435.404583:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201435.404606:0:17256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.404626:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721554 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.404634:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721562 expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.404641:0:17256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.404681:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721562 expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.404695:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721562 expref: 20 pid: 17233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201435.404724:0:17256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681322624:0@lo:104: 00000100:00100000:3.0:1788201435.405329:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201435.405509:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721554 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.405519:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721554 expref: 20 pid: 17234 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201435.405530:0:17256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681322752:0@lo:104: 00000100:00100000:3.0:1788201435.405556:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788201435.406395:0:18741:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788201435.406402:0:18741:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788201435.406435:0:18741:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201435.406477:0:18741:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201435.406496:0:18741:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788201435.406520:0:18741:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788201435.407240:0:18741:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201435.407410:0:18741:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788201435.413989:0:17256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201435.420988:0:17223:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201435.421020:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681322624 00000100:00100000:1.0:1788201435.421030:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681322624 00000100:00100000:1.0:1788201435.421087:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681322752 00000100:00100000:1.0:1788201435.421091:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681322752 00000100:00100000:1.0:1788201435.421109:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201435.421119:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:17256:x1875064681322624:12345-0@lo:104: 00010000:00010000:1.0:1788201435.421138:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201435.421242:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201435.421249:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:17256:x1875064681322624:12345-0@lo:104: Request processed in 131us (15923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201435.421268:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201435.421286:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201435.421293:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:17256:x1875064681322752:12345-0@lo:104: 00010000:00010000:1.0:1788201435.421300:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201435.421339:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201435.421344:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:17256:x1875064681322752:12345-0@lo:104: Request processed in 53us (15787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201435.421350:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201435.422935:0:17256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681322624:0@lo:104: 00000100:00100000:3.0:1788201435.422949:0:17256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681322752:0@lo:104: 00010000:00010000:3.0:1788201435.422972:0:17256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201435.426884:0:17224:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1788201435.432004:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201435.432015:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432027:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201435.432031:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432051:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201435.432075:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201435.432080:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201435.432131:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432138:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201435.432168:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432175:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1000/0xf9b71aee44721562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721569 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432188:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201435.432192:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432197:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1a00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201435.432200:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432206:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201435.432211:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201435.432217:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201435.432238:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432243:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201435.432257:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432264:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1a00/0xf9b71aee44721554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472155b expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201435.432277:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201435.432279:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201435.432280:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201435.432345:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201435.432364:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681322880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201435.432427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.432474:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681323008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201435.432497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.432903:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681322880 00000100:00100000:0.0:1788201435.432911:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681322880 00010000:00010000:0.0:1788201435.432938:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721562 expref: 21 pid: 17233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201435.432966:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681323008 00000100:00100000:0.0:1788201435.432969:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681323008 00010000:00010000:0.0:1788201435.432979:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721554 expref: 22 pid: 17234 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201435.432991:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201435.432999:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:3644:x1875064681322880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201435.433019:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201435.433024:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721562 expref: 22 pid: 17233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433036:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721562 expref: 22 pid: 17233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433061:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bac00/0xf9b71aee44721569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721562 expref: 22 pid: 17233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433074:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201435.433115:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:3644:x1875064681322880:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.433122:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201435.433140:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201435.433146:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba1ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:3646:x1875064681323008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201435.433154:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201435.433158:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721554 expref: 20 pid: 17234 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433167:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721554 expref: 20 pid: 17234 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433177:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367da00/0xf9b71aee4472155b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721554 expref: 20 pid: 17234 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433189:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433197:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201435.433219:0:17226:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028636878s 00010000:00010000:0.0:1788201435.433225:0:17226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433232:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433239:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433246:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433252:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201435.433256:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433265:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433280:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433290:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201435.433319:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba1ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:3646:x1875064681323008:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.433326:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788201435.433371:0:17256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433391:0:17256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201435.433398:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44721611 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201435.433434:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681323008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201435.433462:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681322880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201435.456917:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201436.025214:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201436.278208:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681323136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201436.278292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201436.278421:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681323136 00000100:00100000:1.0:1788201436.278429:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681323136 00000100:00100000:1.0:1788201436.278483:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201436.278493:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681323136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201436.278525:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788201436.278572:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681323136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201436.278579:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201436.278656:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681323136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201436.278867:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681323264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201436.278897:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201436.279006:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681323264 00000100:00100000:3.0:1788201436.279010:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681323264 00000100:00100000:3.0:1788201436.279035:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201436.279052:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681323264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201436.279072:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788201436.279109:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681323264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201436.279123:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201436.279160:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681323264:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788201436.395695:0:18820:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201436.395971:0:18820:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201437.046970:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201437.366019:0:17237:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201437.366036:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b3251800 from 9 10000000:01000000:0.0:1788201437.366041:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201437.366088:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201437.366100:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201437.366111:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201437.366135:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681323392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201437.366206:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201437.366253:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201437.367038:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681323392 00000100:00100000:2.0:1788201437.367047:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681323392 00000100:00100000:2.0:1788201437.367103:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201437.367112:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:17237:x1875064681323392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201437.367125:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201437.367140:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721618 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.367164:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721618 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.367175:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721618 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.367185:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e0000, rc 0) 00000100:00100000:2.0:1788201437.367236:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:17237:x1875064681323392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201437.367243:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201437.367377:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681323392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201437.367393:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.367402:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201437.367460:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681323520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201437.367492:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201437.367516:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201437.367566:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681323520 00000100:00100000:2.0:1788201437.367570:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681323520 00000100:00100000:2.0:1788201437.367586:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201437.367592:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:17237:x1875064681323520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201437.367610:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201437.367625:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201437.367628:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788201437.367713:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:17237:x1875064681323520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201437.367720:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201437.368019:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681323520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201437.368094:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201437.368102:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.368109:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201437.368117:0:17237:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201437.368119:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0ba1d3800 from 9 10000000:01000000:1.0:1788201437.368121:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201437.368140:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.368147:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.368155:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201437.368168:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681323648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201437.368195:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201437.368255:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201437.371538:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681323648 00000100:00100000:0.0:1788201437.371549:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681323648 00000100:00100000:0.0:1788201437.371610:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788201437.371620:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:17237:x1875064681323648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201437.371637:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201437.371654:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721626 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201437.371681:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721626 expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201437.371693:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721626 expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201437.371702:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367de00, rc 0) 00000100:00100000:0.0:1788201437.371807:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681323648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201437.371814:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788201437.371875:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681323648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201437.371891:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201437.371901:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201437.371963:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681323776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201437.371999:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201437.372023:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084fc4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201437.372044:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681323776 00000100:00100000:0.0:1788201437.372048:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681323776 00000100:00100000:0.0:1788201437.372075:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201437.372082:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681323776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201437.372096:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201437.372111:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201437.372115:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788201437.372190:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681323776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201437.372198:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201437.372229:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681323776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788201437.372298:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201437.372305:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201437.372313:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.072091:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201438.583013:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788201439.094341:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201440.117981:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201440.374006:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201440.374023:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201440.374026:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201440.374029:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201440.374045:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201440.374048:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201440.374051:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201440.374053:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201440.374094:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681324288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.374201:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201440.374207:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681323904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.374259:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681324416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374281:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.374318:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681324032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.374365:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681324544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.374402:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201440.374406:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681324160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.374435:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681324672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.374475:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681324288 00000100:00100000:2.0:1788201440.374482:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681324288 00000100:00100000:2.0:1788201440.374699:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681324032 00000100:00100000:2.0:1788201440.374704:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681324032 00000100:00100000:2.0:1788201440.374720:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201440.374728:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681324288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374815:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681324288:12345-0@lo:400:kworker.0 Request processed in 87us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.374823:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201440.374842:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201440.374848:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681324032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374881:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681324032:12345-0@lo:400:kworker.0 Request processed in 34us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.374887:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201440.374905:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681323904 00000100:00100000:2.0:1788201440.374909:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681323904 00000100:00100000:2.0:1788201440.374938:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201440.374944:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:3644:x1875064681323904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.374983:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:3644:x1875064681323904:12345-0@lo:400:kworker.0 Request processed in 39us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.374989:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201440.375033:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681324416 00000100:00100000:2.0:1788201440.375037:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681324416 00000100:00100000:2.0:1788201440.375054:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681324544 00000100:00100000:2.0:1788201440.375056:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681324544 00000100:00100000:2.0:1788201440.375075:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681324160 00000100:00100000:2.0:1788201440.375077:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681324160 00000100:00100000:2.0:1788201440.375086:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681324672 00000100:00100000:2.0:1788201440.375089:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681324672 00000100:00100000:2.0:1788201440.375103:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201440.375109:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681324416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.375139:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681324416:12345-0@lo:400:kworker.0 Request processed in 30us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.375145:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201440.375156:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201440.375162:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681324544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.375189:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681324544:12345-0@lo:400:kworker.0 Request processed in 26us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.375195:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201440.375207:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201440.375213:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681324160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.375237:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681324160:12345-0@lo:400:kworker.0 Request processed in 25us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.375243:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201440.375252:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201440.375266:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681324672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.375310:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681324672:12345-0@lo:400:kworker.0 Request processed in 45us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.375316:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788201440.375467:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201440.375471:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201440.375507:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681323904:0@lo:400:kworker.0 00010000:00080000:1.0:1788201440.375525:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf837a5f80 x1875064681324416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201440.375537:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681324416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201440.375549:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681324288:0@lo:400:kworker.0 00010000:00080000:2.0:1788201440.375678:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf837a7800 x1875064681324160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201440.375689:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681324160:0@lo:400:kworker.0 00010000:00080000:2.0:1788201440.375702:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf837a4380 x1875064681324672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201440.375711:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681324672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.375721:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681324032:0@lo:400:kworker.0 00010000:00080000:2.0:1788201440.375730:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf837a7b80 x1875064681324544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201440.375757:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681324544:0@lo:400:kworker.0 00010000:00010000:1.0:1788201441.155677:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201441.398281:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681324800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201441.398350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201441.398409:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681324800 00000100:00100000:1.0:1788201441.398416:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681324800 00000100:00100000:1.0:1788201441.398464:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201441.398473:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681324800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201441.398508:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788201441.398551:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681324800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201441.398557:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201441.398674:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681324928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201441.398701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201441.398816:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681324928 00000100:00100000:1.0:1788201441.398820:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681324928 00000100:00100000:1.0:1788201441.398835:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201441.398841:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681324928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201441.398859:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788201441.398906:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681324928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201441.398929:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201441.398989:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681324800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201441.399140:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681324928:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788201441.791665:0:19110:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201442.166007:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201442.361665:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788201442.533396:0:19162:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201442.533632:0:19162:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201443.196193:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788201443.443809:0:19212:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201443.444060:0:19212:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201444.214215:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201445.239701:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201445.495465:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201445.495473:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201445.495476:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201445.495479:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201445.495532:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201445.495536:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201445.495539:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201445.495543:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201445.495606:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681325184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.495698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201445.495813:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681325696:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.495913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201445.495952:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201445.495960:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681325056:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201445.496041:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681325568:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201445.496096:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681325056 00000100:00100000:3.0:1788201445.496110:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681325056 00000100:00100000:0.0:1788201445.496110:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681325440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496156:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201445.496181:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201445.496195:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201445.496208:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:3647:x1875064681325056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496214:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681325312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201445.496354:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681325184 00000100:00100000:1.0:1788201445.496361:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681325184 00000100:00100000:1.0:1788201445.496406:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681325440 00000100:00100000:1.0:1788201445.496409:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681325440 00000100:00100000:1.0:1788201445.496425:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201445.496433:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681325184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496504:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681325824:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201445.496556:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681325696 00000100:00100000:0.0:1788201445.496560:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681325696 00000100:00100000:0.0:1788201445.496597:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681325568 00000100:00100000:0.0:1788201445.496601:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681325568 00000100:00100000:0.0:1788201445.496624:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681325312 00000100:00100000:0.0:1788201445.496627:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681325312 00000100:00100000:0.0:1788201445.496637:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681325824 00000100:00100000:0.0:1788201445.496640:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681325824 00000100:00100000:0.0:1788201445.496654:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201445.496661:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681325696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496704:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681325696:12345-0@lo:400:kworker.0 Request processed in 43us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201445.496712:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201445.496731:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201445.496758:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681325568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496789:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681325568:12345-0@lo:400:kworker.0 Request processed in 52us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201445.496795:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201445.496806:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201445.496812:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681325312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.496859:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681325312:12345-0@lo:400:kworker.0 Request processed in 46us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201445.496866:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201445.496883:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201445.496890:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681325824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201445.496908:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:3647:x1875064681325056:12345-0@lo:400:kworker.0 Request processed in 699us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201445.496919:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788201445.496941:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681325824:12345-0@lo:400:kworker.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201445.496949:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788201445.497030:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf4eaa00 x1875064681325312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201445.497058:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681325312:0@lo:400:kworker.0 00010000:00080000:0.0:1788201445.497071:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf841c7b80 x1875064681325824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201445.497078:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681325824:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.497109:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681325056:0@lo:400:kworker.0 00010000:00080000:0.0:1788201445.497121:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf4e8380 x1875064681325568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201445.497129:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681325568:0@lo:400:kworker.0 00010000:00080000:0.0:1788201445.497139:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf4e9500 x1875064681325696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201445.497146:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681325696:0@lo:400:kworker.0 00000100:00080000:0.0:1788201445.500824:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201445.500839:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201445.500987:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681325184:12345-0@lo:400:kworker.0 Request processed in 4538us (5273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201445.501003:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201445.501055:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201445.501070:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681325440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.501257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681325184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201445.501321:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681325440:12345-0@lo:400:kworker.0 Request processed in 258us (5165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201445.501327:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201445.501948:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681325440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201445.623870:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201430/real 1788201430] req@ffff9cdf8410ca80 x1875064681317248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201445.623911:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cdf8410ca80 x1875064681317248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201445.623922:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201430/real 1788201430] req@ffff9cdf8410c700 x1875064681317376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201445.623933:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cdf8410c700 x1875064681317376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201445.623957:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a026b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201445.623994:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201445.623999:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681317248:0@lo:8:kworker.0 00000100:00080000:3.0:1788201445.624006:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201445.624012:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201445.624026:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681317376:0@lo:8:kworker.0 00000100:00080000:2.0:1788201445.624104:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201445.624110:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201445.624113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201445.624116:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201445.624120:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201445.624130:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201445.624133:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0a026b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201445.624139:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1788201445.624147:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201445.624154:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce0a026b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201445.624208:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8333e680 x1875064681325952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201445.624233:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201445.624236:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788201445.624238:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201445.624241:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1788201445.624244:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201445.624248:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce0bf443000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201445.624261:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8333ed80 x1875064681326080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201445.626294:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681325952:0@lo:8:kworker.0 00000100:00100000:3.0:1788201445.626401:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201445.626480:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681326080:0@lo:8:kworker.0 00000100:00100000:3.0:1788201445.626510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201445.630399:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681325952 00000100:00100000:2.0:1788201445.630420:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681325952 00000100:00100000:2.0:1788201445.630481:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681326080 00000100:00100000:2.0:1788201445.630486:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681326080 00000100:00100000:2.0:1788201445.630506:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201445.630516:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875064681325952:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788201445.630560:0:18746:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:2.0:1788201445.630600:0:18746:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44721634 00002000:00100000:2.0:1788201445.630621:0:18746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9cdf81984000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788201445.630626:0:18746:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788201445.630638:0:18746:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201445.633585:0:18746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788201445.633644:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9cdf81985800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201445.634005:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681325952:12345-0@lo:8:kworker.0 Request processed in 3487us (7600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201445.634016:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201445.634061:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201445.634069:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875064681326080:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201445.634095:0:18746:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788201445.634940:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8333e680 x1875064681325952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201445.634956:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201445.634982:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788201445.634994:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201445.635003:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788201445.635030:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a026b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201445.635065:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201445.635074:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681325952:0@lo:8:kworker.0 00000004:00080000:1.0:1788201445.635170:0:17982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788201445.635201:0:17982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17982:1875064681326336:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788201445.635273:0:17982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201445.635310:0:17982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201445.635327:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681326208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201445.635357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201445.635406:0:18748:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788201445.635415:0:18748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788201445.635446:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681326208 00000100:00100000:1.0:1788201445.635466:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681326208 00000100:00100000:1.0:1788201445.635528:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201445.635538:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875064681326208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201445.635576:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201445.635622:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875064681326208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201445.635629:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788201445.635781:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201445.635807:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6a8a80 x1875064681326208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201445.635826:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681326208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201445.635869:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681326336 00000100:00100000:1.0:1788201445.635873:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681326336 00000100:00100000:1.0:1788201445.635983:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201445.635992:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17982:x1875064681326336:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788201445.636956:0:17981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201445.637088:0:17981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 525934348714ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788201445.637097:0:17981:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788201445.647297:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875064681326080:12345-0@lo:8:kworker.0 Request processed in 13218us (20776us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201445.647312:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788201445.647368:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201445.647374:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201445.647378:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681326080:0@lo:8:kworker.0 00000004:00080000:3.0:1788201445.647611:0:17973:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788201445.651448:0:19309:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788201445.651473:0:19309:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788201445.651621:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17982:x1875064681326336:12345-0@lo:7:osp-pre-0-1.0 Request processed in 15624us (16341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201445.651645:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788201445.652133:0:17982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6aa680 x1875064681326336/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201445.652151:0:17982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17982:1875064681326336:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788201445.652168:0:17982:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788201445.652223:0:17982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17982:1875064681326464:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788201445.652272:0:17982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201445.652345:0:17982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201445.658151:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681326464 00000100:00100000:0.0:1788201445.658174:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681326464 00000100:00100000:2.0:1788201445.658712:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201445.658726:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17982:x1875064681326464:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788201445.658802:0:18748:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788201445.658927:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17982:x1875064681326464:12345-0@lo:5:osp-pre-0-1.0 Request processed in 204us (6654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201445.658945:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788201445.659362:0:17982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8333ed80 x1875064681326464/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201445.659381:0:17982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17982:1875064681326464:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788201445.659400:0:17982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788201445.659472:0:17982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17982:1875064681326592:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788201445.659524:0:17982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201445.659556:0:17982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201445.659580:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681326592 00000100:00100000:3.0:1788201445.659586:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681326592 00000100:00100000:3.0:1788201445.659623:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201445.659632:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17982:x1875064681326592:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788201445.659669:0:18746:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1788201445.721171:0:18742:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788201445.721189:0:18742:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788201445.721468:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17982:x1875064681326592:12345-0@lo:5:osp-pre-0-1.0 Request processed in 61830us (61936us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788201445.721483:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788201445.721586:0:17982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b94c4a80 x1875064681326592/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201445.721601:0:17982:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788201445.721609:0:17982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17982:1875064681326592:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788201445.721640:0:17982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788201445.721703:0:17982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17982:1875064681326720:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788201445.721863:0:17982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201445.721895:0:17982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201445.722033:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681326720 00000100:00100000:2.0:1788201445.722041:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681326720 00000100:00100000:2.0:1788201445.722095:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201445.722106:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17982:x1875064681326720:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788201445.722172:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17982:x1875064681326720:12345-0@lo:900:osp-pre-0-1.0 Request processed in 68us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201445.722180:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201445.723207:0:17982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b94c4a80 x1875064681326720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201445.723227:0:17982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17982:1875064681326720:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788201446.265951:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201446.520636:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681326848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201446.520721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201446.520894:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681326848 00000100:00100000:2.0:1788201446.520901:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681326848 00000100:00100000:2.0:1788201446.520952:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201446.520971:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681326848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201446.521010:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201446.521055:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681326848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201446.521061:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201446.521198:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681326848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201446.529813:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201446.529838:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681326976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201446.529906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201446.529958:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681326976 00000100:00100000:0.0:1788201446.529973:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681326976 00000100:00100000:0.0:1788201446.530019:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201446.530028:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681326976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201446.530061:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788201446.530108:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681326976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201446.530115:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201446.530161:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681326976:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788201447.286878:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201448.310719:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201448.822451:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788201449.336139:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201450.261719:0:19558:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201450.261726:0:19558:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788201450.261728:0:19558:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788201450.262581:0:19558:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ce0849b8800 00000020:01000004:0.0:1788201450.262606:0:19558:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788201450.262628:0:19558:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788201450.263330:0:19558:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ce0a6580000) 00000020:00000080:0.0:1788201450.263359:0:19558:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201450.333482:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788201450.340366:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201450.341269:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788201450.341606:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201450.346090:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788201450.346859:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201450.347169:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788201450.350254:0:19558:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201450.350585:0:19558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788201450.350605:0:19558:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201450.350621:0:19558:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf9b71aee44721642 00000020:01000004:3.0:1788201450.350630:0:19558:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788201450.350668:0:19558:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201450.350768:0:19558:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201450.350777:0:19558:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788201450.350814:0:19558:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788201450.350819:0:19558:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:1.0:1788201450.360252:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788201450.369522:0:19558:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201450.369577:0:19558:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788201450.369582:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201450.369584:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201450.369586:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201450.369593:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201450.369594:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201450.369595:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201450.369597:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201450.369599:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201450.369600:0:19558:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201450.369604:0:19558:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788201450.369606:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201450.369608:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201450.369609:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201450.369609:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201450.369610:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201450.369611:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201450.369612:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201450.369613:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201450.369614:0:19558:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201450.370058:0:19558:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788201450.370089:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201450.370189:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.370288:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08507f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201450.370337:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681327104 00000100:00100000:3.0:1788201450.370346:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681327104 00000100:00100000:3.0:1788201450.370430:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788201450.370450:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:19558:x1875064681327104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201450.370498:0:17233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788201450.370501:0:17233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788201450.370506:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788201450.370949:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:19558:x1875064681327104:12345-0@lo:253:mount.lustre.0 Request processed in 498us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201450.370959:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788201450.371051:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327104:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201450.371063:0:19558:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788201450.371066:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201450.371068:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201450.371070:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201450.371078:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201450.371079:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201450.371080:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201450.371082:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201450.371084:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201450.371085:0:19558:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201450.371110:0:19558:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0849b8800 from lustre-OST0001 10000000:01000000:0.0:1788201450.371144:0:19558:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788201450.371147:0:19558:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788201450.371156:0:19558:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0b9700000 local copy 00010000:00010000:0.0:1788201450.371168:0:19558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201450.371283:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201450.371314:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201450.371678:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854cbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.371892:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681327232 00000100:00100000:2.0:1788201450.371899:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681327232 00000100:00100000:2.0:1788201450.371932:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201450.371950:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:19558:x1875064681327232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201450.372024:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:19558:x1875064681327232:12345-0@lo:501:mount.lustre.0 Request processed in 84us (709us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201450.372031:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788201450.372186:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327232:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788201450.372204:0:19558:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788201450.372222:0:19558:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788201450.372229:0:19558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.372240:0:19558:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201450.372270:0:19558:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0849b8800 10000000:01000000:0.0:1788201450.372274:0:19558:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201450.372280:0:19558:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788201450.372282:0:19558:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201450.372287:0:19558:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788201450.372290:0:19558:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201450.372321:0:19558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.372330:0:19558:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.372341:0:19558:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201450.372355:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201450.372382:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201450.372407:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0854cbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.372460:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681327360 00000100:00100000:2.0:1788201450.372464:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681327360 00000100:00100000:2.0:1788201450.372480:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201450.372486:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:19558:x1875064681327360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201450.372494:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201450.372507:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf825e1200/0xf9b71aee44721650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721649 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201450.372537:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf825e1200/0xf9b71aee44721650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721649 expref: 22 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201450.372547:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf825e1200/0xf9b71aee44721650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721649 expref: 22 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201450.372557:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf825e1200, rc 0) 00000100:00100000:2.0:1788201450.372625:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327360:12345-0@lo:101:mount.lustre.0 Request processed in 138us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.372631:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788201450.373134:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201450.373150:0:19558:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.373161:0:19558:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201450.374416:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788201450.376117:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201450.380167:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788201450.380245:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788201450.380266:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788201450.380282:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788201450.380295:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788201450.380308:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788201450.380338:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788201450.380344:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788201450.380569:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201450.381057:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201450.381167:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.381228:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681327488 00000100:00100000:2.0:1788201450.381237:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681327488 00000100:00100000:2.0:1788201450.381328:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201450.381339:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201450.381610:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327488:12345-0@lo:501:mount.lustre.0 Request processed in 272us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.381619:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788201450.381731:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201450.382105:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201450.382162:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201450.382201:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201450.382322:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681327616 00000100:00100000:3.0:1788201450.382328:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681327616 00000100:00100000:3.0:1788201450.382374:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788201450.382383:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201450.383507:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327616:12345-0@lo:503:mount.lustre.0 Request processed in 1118us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201450.383519:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201450.383646:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201450.384497:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201450.384609:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201450.385039:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201450.385137:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.385341:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681327744 00000100:00100000:2.0:1788201450.385350:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681327744 00000100:00100000:2.0:1788201450.385406:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201450.385417:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.386550:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327744:12345-0@lo:502:mount.lustre.0 Request processed in 1128us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.386562:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201450.387018:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201450.387333:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788201450.387370:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788201450.387383:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788201450.387395:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788201450.387408:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788201450.387420:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788201450.387432:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788201450.387528:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788201450.387545:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788201450.387604:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201450.388110:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201450.388204:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201450.388280:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681327872 00000100:00100000:3.0:1788201450.388289:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681327872 00000100:00100000:3.0:1788201450.388347:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201450.388358:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201450.388512:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681327872:12345-0@lo:502:mount.lustre.0 Request processed in 155us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201450.388519:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201450.388690:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681327872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201450.388788:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788201450.388800:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788201450.390180:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201450.390193:0:19562:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788201450.390200:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201450.390203:0:19562:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788201450.390210:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201450.390230:0:19562:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ce0a643cd40) 00000020:00000080:1.0:1788201450.390264:0:19562:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788201450.390272:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201450.390376:0:19562:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0849b8800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788201450.390386:0:19562:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201450.390395:0:19562:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf9b71aee4472165e 00010000:00010000:1.0:1788201450.402965:0:19562:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788201450.403565:0:19562:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788201450.407784:0:19562:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788201450.411327:0:19562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788201450.411353:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201450.411361:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201450.411363:0:19562:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788201450.411366:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201450.411371:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201450.411373:0:19562:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788201450.411376:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788201450.411378:0:19562:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788201450.411380:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201450.411383:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201450.411384:0:19562:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788201450.411387:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201450.411389:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201450.411390:0:19562:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201450.411394:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788201450.411433:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201450.411588:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201450.411591:0:19562:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201450.411595:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788201450.411987:0:19558:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788201450.412029:0:19558:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788201450.412063:0:19558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201450.412077:0:19558:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201450.412087:0:19558:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0849b8800 from 1 10000000:01000000:2.0:1788201450.412090:0:19558:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201450.412137:0:19558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201450.412145:0:19558:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201450.412158:0:19558:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201450.412192:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201450.412280:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.412690:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201450.426175:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681328000 00000100:00100000:3.0:1788201450.426197:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681328000 00000100:00100000:3.0:1788201450.426292:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201450.426305:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:19558:x1875064681328000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201450.426328:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201450.426352:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721665 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.426411:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721665 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.426424:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721665 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.426435:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bac00, rc 0) 00000100:00100000:3.0:1788201450.426543:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328000:12345-0@lo:101:mount.lustre.0 Request processed in 240us (14262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201450.426551:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788201450.428099:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201450.428130:0:19558:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201450.428146:0:19558:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201450.429383:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788201450.430011:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201450.430267:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788201450.430303:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788201450.430322:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788201450.430328:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788201450.430420:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201450.430507:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.430609:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201450.430726:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681328128 00000100:00100000:0.0:1788201450.430890:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681328128 00000100:00100000:0.0:1788201450.431005:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788201450.431018:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201450.431173:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328128:12345-0@lo:501:mount.lustre.0 Request processed in 157us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201450.431181:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788201450.431266:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201450.431303:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201450.431351:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.431484:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201450.431545:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681328256 00000100:00100000:3.0:1788201450.431550:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681328256 00000100:00100000:3.0:1788201450.431572:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201450.431579:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201450.431689:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328256:12345-0@lo:503:mount.lustre.0 Request processed in 110us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201450.431696:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201450.431974:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201450.432410:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201450.432490:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.432542:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.432583:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201450.432649:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681328384 00000100:00100000:3.0:1788201450.432655:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681328384 00000100:00100000:2.0:1788201450.433079:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201450.433106:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.433231:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328384:12345-0@lo:502:mount.lustre.0 Request processed in 143us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.433239:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201450.433347:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201450.433623:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788201450.433655:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788201450.433669:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788201450.433697:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788201450.433711:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788201450.433725:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788201450.433924:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788201450.433962:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788201450.433978:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788201450.433991:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788201450.434003:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788201450.434039:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201450.434094:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201450.434127:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2efa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.434193:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681328512 00000100:00100000:2.0:1788201450.434199:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681328512 00000100:00100000:2.0:1788201450.434229:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201450.434236:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.434329:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328512:12345-0@lo:502:mount.lustre.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.434343:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201450.434441:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201450.434482:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788201450.434491:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788201450.435600:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201450.435626:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201450.435629:0:19566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201450.435637:0:19566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0849b8800 00000020:00000080:2.0:1788201450.435640:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201450.435650:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201450.435652:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201450.435654:0:19566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201450.435656:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201450.435659:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201450.435660:0:19566:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201450.435663:0:19566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0849b8800 00000020:00000080:2.0:1788201450.435665:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201450.436336:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201450.436343:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201450.436345:0:19566:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788201450.436348:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201450.436351:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201450.436352:0:19566:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201450.436356:0:19566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0849b8800 00000020:00000080:2.0:1788201450.436358:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201450.437924:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201450.437936:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201450.437946:0:19566:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201450.437950:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201450.437955:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201450.437957:0:19566:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788201450.437962:0:19566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0849b8800 00000020:00000080:2.0:1788201450.437964:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201450.438025:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201450.438028:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201450.438036:0:19566:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788201450.438040:0:19566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788201450.447790:0:19558:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788201450.447864:0:19558:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201450.447896:0:19558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.447911:0:19558:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201450.448001:0:19558:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201450.448005:0:19558:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0849b8800 10000000:01000000:3.0:1788201450.448008:0:19558:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0849b8800 10000000:01000000:3.0:1788201450.448013:0:19558:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201450.448019:0:19558:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0849b8800 from 1 10000000:01000000:3.0:1788201450.448022:0:19558:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201450.448069:0:19558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.448079:0:19558:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.448108:0:19558:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201450.448140:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201450.448229:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201450.448286:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201450.448845:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681328640 00000100:00100000:3.0:1788201450.448856:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681328640 00000100:00100000:3.0:1788201450.448910:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201450.448921:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:19558:x1875064681328640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201450.448948:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201450.448965:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee4472167a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721673 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.448996:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee4472167a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721673 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.449008:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee4472167a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721673 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.449018:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbe00, rc 0) 00000100:00100000:3.0:1788201450.449072:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681328640:12345-0@lo:101:mount.lustre.0 Request processed in 152us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201450.449079:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201450.449134:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201450.449149:0:19558:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201450.449167:0:19558:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201450.451853:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788201450.452236:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201450.452454:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788201450.452481:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788201450.452495:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788201450.452509:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788201450.452523:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788201450.452535:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788201450.452549:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788201450.452581:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788201450.452595:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788201450.452607:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788201450.452617:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788201450.452630:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788201450.452644:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788201450.452657:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788201450.455650:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788201450.455855:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788201450.455871:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788201450.455884:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788201450.455896:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788201450.455908:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788201450.455920:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788201450.455931:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788201450.455956:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788201450.455992:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788201450.456007:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788201450.456020:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788201450.456044:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788201450.456056:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788201450.456069:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788201450.456081:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788201450.456093:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788201450.456104:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788201450.456116:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788201450.456129:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788201450.456143:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788201450.456157:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788201450.456168:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788201450.456182:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788201450.456196:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788201450.456225:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788201450.456239:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788201450.456252:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788201450.456266:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788201450.456279:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788201450.456290:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788201450.456302:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788201450.456332:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788201450.456338:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788201450.456482:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201450.456573:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201450.456643:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.458864:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681328768 00000100:00100000:2.0:1788201450.458882:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681328768 00000100:00100000:2.0:1788201450.458964:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788201450.458978:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681328768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201450.459198:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681328768:12345-0@lo:501:mount.lustre.0 Request processed in 224us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.459207:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201450.459519:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201450.459581:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201450.459639:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201450.459721:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.465844:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681328896 00000100:00100000:2.0:1788201450.465863:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681328896 00000100:00100000:2.0:1788201450.465950:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201450.465962:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681328896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201450.466170:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681328896:12345-0@lo:503:mount.lustre.0 Request processed in 210us (6530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.466178:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201450.466267:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681328896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201450.466848:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201450.466962:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681329024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.467024:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.467058:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681329024 00000100:00100000:2.0:1788201450.467063:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681329024 00000100:00100000:2.0:1788201450.467089:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201450.467096:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681329024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.467192:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681329024:12345-0@lo:502:mount.lustre.0 Request processed in 96us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.467208:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201450.467252:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.467268:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681329024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201450.467457:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788201450.467484:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788201450.467497:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788201450.467511:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788201450.467526:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788201450.467540:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788201450.467555:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788201450.467569:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788201450.467583:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788201450.467596:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788201450.467609:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788201450.467624:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788201450.467637:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788201450.467651:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788201450.467664:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788201450.467676:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788201450.467689:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788201450.467701:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788201450.467714:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788201450.467727:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788201450.467769:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788201450.467786:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788201450.467800:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788201450.467814:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788201450.467827:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788201450.467838:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788201450.467852:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788201450.467878:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788201450.467892:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788201450.467905:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788201450.467918:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788201450.467930:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788201450.467956:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788201450.467972:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788201450.467985:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788201450.467998:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788201450.468012:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788201450.468027:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788201450.468041:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788201450.468052:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788201450.468066:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788201450.468078:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788201450.468090:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788201450.468105:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788201450.468119:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788201450.468133:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788201450.468145:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788201450.468157:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788201450.468198:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681329152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.468253:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.468297:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681329152 00000100:00100000:2.0:1788201450.468304:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681329152 00000100:00100000:2.0:1788201450.468336:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201450.468343:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681329152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.468435:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681329152:12345-0@lo:502:mount.lustre.0 Request processed in 92us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.468443:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201450.468491:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.468510:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681329152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201450.468671:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788201450.468693:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788201450.468713:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681329280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.468774:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.468793:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681329280 00000100:00100000:2.0:1788201450.468797:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681329280 00000100:00100000:2.0:1788201450.468818:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201450.468825:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681329280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201450.468884:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681329280:12345-0@lo:502:mount.lustre.0 Request processed in 59us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.468890:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201450.468920:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201450.468932:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681329280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201450.477551:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788201450.477577:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788201450.479019:0:19572:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788201450.479054:0:19572:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ce0a65819c0) 00000020:00000080:0.0:1788201450.479091:0:19572:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788201450.479314:0:19572:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0849b8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788201450.479319:0:19572:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0849b8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788201450.479322:0:19572:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0849b8800 3 00010000:00080000:0.0:1788201450.479362:0:19572:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf826f1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1788201450.485020:0:19572:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788201450.486435:0:19572:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788201450.486495:0:19572:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201450.486516:0:19572:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf9b71aee44721688 00000100:00080000:0.0:1788201450.486527:0:19572:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201450.487573:0:19572:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf826f1800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201450.487619:0:19572:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf841c5880 x1875064681329408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201450.487683:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681329408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201450.488029:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201450.488092:0:19572:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201450.488403:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201450.488408:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201450.488410:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201450.488413:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201450.488446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201450.488450:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788201450.488454:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201450.488460:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:0.0:1788201450.488465:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201450.488478:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce0bf443000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201450.488499:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf841c6300 x1875064681330048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201450.488537:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681329408 00000100:00100000:2.0:1788201450.488553:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681329408 00000100:00100000:2.0:1788201450.488615:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201450.488626:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681329408:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201450.488634:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681329792:0@lo:400:kworker.0 00010000:00080000:2.0:1788201450.488666:0:17242:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000100:00100000:0.0:1788201450.488680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201450.488707:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681330432:0@lo:400:kworker.0 00000020:00000080:2.0:1788201450.488717:0:17242:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf9b71aee4472168f 00000100:00100000:0.0:1788201450.488765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201450.488791:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201450.488799:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681329920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201450.488830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201450.488871:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681329792 00000100:00100000:0.0:1788201450.488878:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681329792 00000100:00100000:0.0:1788201450.488934:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201450.488955:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681329792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201450.489007:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681329792:12345-0@lo:400:kworker.0 Request processed in 54us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201450.489013:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201450.489046:0:17241:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201450.489055:0:17241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788201450.489084:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681329920 00000100:00100000:0.0:1788201450.489088:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681329920 00000100:00100000:1.0:1788201450.489115:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681329536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201450.489180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201450.489213:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681330176:0@lo:400:kworker.0 00000100:00100000:1.0:1788201450.489236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201450.489251:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201450.489269:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681329664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201450.489292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201450.489304:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681330304:0@lo:400:kworker.0 00000100:00100000:1.0:1788201450.489332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201450.489361:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681329536 00000100:00100000:1.0:1788201450.489366:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681329536 00000100:00100000:1.0:1788201450.489398:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201450.489416:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681329536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201450.489467:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681329536:12345-0@lo:400:kworker.0 Request processed in 52us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201450.489474:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201450.489520:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681329536:0@lo:400:kworker.0 00000100:00080000:1.0:1788201450.489628:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201450.489656:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201450.489666:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681329920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201450.489712:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681329920:12345-0@lo:400:kworker.0 Request processed in 49us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201450.489718:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201450.489780:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681330048:0@lo:8:kworker.0 00000100:00100000:0.0:1788201450.489827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788201450.489880:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf841c6d80 x1875064681329920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201450.489893:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681329920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201450.489904:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681329792:0@lo:400:kworker.0 00000004:00100000:2.0:1788201450.490859:0:17242:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201450.490931:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201450.491035:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875064681329408:12345-0@lo:38:llog_process_th.0 Request processed in 2408us (3003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.491054:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201450.491087:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681330432 00000100:00100000:2.0:1788201450.491093:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681330432 00000100:00100000:2.0:1788201450.491129:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681330176 00000100:00100000:2.0:1788201450.491131:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681330176 00000100:00100000:2.0:1788201450.491143:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681329664 00000100:00100000:2.0:1788201450.491145:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681329664 00000100:00100000:2.0:1788201450.491154:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681330304 00000100:00100000:2.0:1788201450.491156:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681330304 00000100:00100000:2.0:1788201450.491171:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201450.491178:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681330432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201450.491218:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681330432:12345-0@lo:400:kworker.0 Request processed in 41us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.491224:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201450.491234:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201450.491240:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681330176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201450.491272:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681330176:12345-0@lo:400:kworker.0 Request processed in 32us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.491277:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201450.491288:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201450.491294:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681329664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201450.491321:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681329664:12345-0@lo:400:kworker.0 Request processed in 28us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.491327:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201450.491339:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201450.491345:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681330304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201450.491386:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875064681330304:12345-0@lo:400:kworker.0 Request processed in 41us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.491393:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201450.491679:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681330048 00000100:00100000:2.0:1788201450.491685:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681330048 00000100:00100000:2.0:1788201450.491712:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201450.491719:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875064681330048:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788201450.491813:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875064681330048:12345-0@lo:8:kworker.0 Request processed in 94us (1984us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201450.491821:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201450.491971:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201450.491981:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201450.491986:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201450.491991:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681330048:0@lo:8:kworker.0 00010000:00080000:2.0:1788201450.492018:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf841c5880 x1875064681329408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201450.492028:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201450.492035:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788201450.492044:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788201450.492050:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201450.492053:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201450.492059:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681329408:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788201450.492099:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201450.492105:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788201450.492125:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf841c7100 x1875064681330432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201450.492149:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681330432:0@lo:400:kworker.0 00010000:00080000:2.0:1788201450.492187:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf841c5c00 x1875064681329664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201450.492199:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681329664:0@lo:400:kworker.0 00010000:00080000:2.0:1788201450.492211:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf841c5500 x1875064681330304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201450.492219:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875064681330304:0@lo:400:kworker.0 00010000:00080000:2.0:1788201450.492231:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf841c7800 x1875064681330176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201450.492239:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681330176:0@lo:400:kworker.0 00000020:01000004:0.0:1788201450.494072:0:19572:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788201450.494090:0:19572:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ce0a6584d40) 00000020:00000080:0.0:1788201450.494133:0:19572:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788201450.495118:0:19572:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0849b8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788201450.495125:0:19572:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0849b8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788201450.495128:0:19572:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0849b8800 3 00010000:00080000:0.0:1788201450.495358:0:19572:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf819da000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1788201450.498694:0:19572:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788201450.499984:0:19572:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788201450.500035:0:19572:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201450.500049:0:19572:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf9b71aee4472169d 00000100:00080000:0.0:1788201450.500060:0:19572:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201450.500066:0:19572:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cdf819da000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201450.500101:0:19572:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf4e9f80 x1875064681330560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201450.500136:0:19572:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788201450.500359:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681330560:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788201450.500412:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201450.500423:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201450.500427:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201450.500430:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201450.500442:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.500540:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681330560 00000100:00100000:2.0:1788201450.500552:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681330560 00000040:00080000:0.0:1788201450.500931:0:19572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1788201450.501008:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201450.501021:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681330560:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788201450.501059:0:17242:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1788201450.501106:0:17242:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf9b71aee447216a4 00000004:00100000:2.0:1788201450.501127:0:17242:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201450.501169:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201450.501274:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875064681330560:12345-0@lo:38:llog_process_th.0 Request processed in 253us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.501281:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788201450.501348:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf4e9f80 x1875064681330560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201450.501360:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201450.501369:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788201450.501386:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201450.501391:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788201450.501395:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf819da000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201450.501402:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681330560:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788201450.501637:0:19558:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788201450.501686:0:19558:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201450.501874:0:19558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201450.501888:0:19558:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201450.501956:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201450.501959:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201450.501961:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201450.501962:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201450.501964:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201450.501965:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201450.501967:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201450.501970:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201450.501971:0:19558:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201450.501976:0:19558:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788201450.501979:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201450.501980:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201450.501982:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201450.501983:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201450.501986:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201450.501988:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201450.501990:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201450.501991:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201450.501992:0:19558:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201450.502018:0:19558:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788201450.502041:0:19558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681330688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201450.502099:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201450.502142:0:19558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf833136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201450.503025:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681330688 00000100:00100000:3.0:1788201450.503035:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681330688 00000100:00100000:3.0:1788201450.503096:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201450.503106:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681330688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201450.503144:0:17233:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788201450.503163:0:17233:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201450.514700:0:17233:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201450.514716:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788201450.516077:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:19558:x1875064681330688:12345-0@lo:253:mount.lustre.0 Request processed in 12959us (13963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201450.516095:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788201450.516198:0:19558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:19558:1875064681330688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201450.516224:0:19558:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788201450.516228:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201450.516230:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201450.516231:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201450.516232:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201450.516233:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201450.516235:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201450.516236:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201450.516237:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201450.516238:0:19558:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201450.516259:0:19558:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788201450.518033:0:17256:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201450.518044:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201450.518076:0:17256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518098:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721618 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518107:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721626 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518114:0:17256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518161:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721626 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518178:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721626 expref: 23 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201450.518194:0:17256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681330816:0@lo:104: 00000100:00100000:0.0:1788201450.518263:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201450.518319:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721618 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518327:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721618 expref: 23 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201450.518343:0:17256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681330944:0@lo:104: 00000100:00100000:0.0:1788201450.518363:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201450.518386:0:17256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201450.518412:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681330816 00000100:00100000:0.0:1788201450.518419:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681330816 00000100:00100000:0.0:1788201450.518460:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681330944 00000100:00100000:0.0:1788201450.518462:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681330944 00000100:00100000:0.0:1788201450.518475:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201450.518484:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:17256:x1875064681330816:12345-0@lo:104: 00010000:00010000:0.0:1788201450.518498:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518546:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201450.518552:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:17256:x1875064681330816:12345-0@lo:104: Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201450.518559:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201450.518574:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201450.518579:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:17256:x1875064681330944:12345-0@lo:104: 00010000:00010000:0.0:1788201450.518586:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518615:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201450.518620:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:17256:x1875064681330944:12345-0@lo:104: Request processed in 41us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201450.518626:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788201450.518640:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201450.518646:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518660:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201450.518664:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518674:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201450.518682:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201450.518688:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201450.518719:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518726:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201450.518784:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518790:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83254000/0xf9b71aee44721626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472162d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518805:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201450.518808:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518814:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ca00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201450.518817:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.518834:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201450.518841:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201450.518847:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201450.518861:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.519980:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201450.520012:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520020:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ca00/0xf9b71aee44721618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472161f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520037:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201450.520040:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201450.520042:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201450.520051:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201450.520069:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681331072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201450.520130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201450.520189:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201450.520198:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681331200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201450.520222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201450.520254:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681331072 00000100:00100000:0.0:1788201450.520261:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681331072 00010000:00010000:0.0:1788201450.520298:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721626 expref: 24 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201450.520325:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681331200 00000100:00100000:0.0:1788201450.520328:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681331200 00010000:00010000:0.0:1788201450.520340:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721618 expref: 25 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201450.520353:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201450.520362:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+25:3647:x1875064681331072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201450.520376:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201450.520381:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721626 expref: 25 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520394:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721626 expref: 25 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520414:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201450.520448:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+25:3647:x1875064681331072:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201450.520455:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201450.520471:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201450.520477:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3645:x1875064681331200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201450.520502:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201450.520506:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721618 expref: 24 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520514:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721618 expref: 24 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520535:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520544:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201450.520561:0:17225:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028636878s 00010000:00010000:0.0:1788201450.520566:0:17225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520573:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520579:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520586:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520592:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201450.520597:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520604:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520612:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520623:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201450.520649:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3645:x1875064681331200:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201450.520661:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201450.520717:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681331200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201450.520772:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681331072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201450.520797:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472162d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721626 expref: 23 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201450.520809:0:17256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681330816:0@lo:104: 00010000:00010000:0.0:1788201450.520820:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0000/0xf9b71aee4472161f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721618 expref: 22 pid: 17234 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201450.520829:0:17256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875064681330944:0@lo:104: 00010000:00010000:0.0:1788201450.520843:0:17256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520851:0:17256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.520858:0:17256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201450.523002:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367d800/0xf9b71aee447216ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788201450.536102:0:19558:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788201450.539379:0:19558:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788201450.539392:0:19558:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788201450.539455:0:19558:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201450.539510:0:19558:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201450.539536:0:19558:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788201450.539570:0:19558:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788201450.556622:0:19558:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201450.559366:0:19558:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788201451.129788:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681331328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201451.129883:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.130001:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681331328 00000100:00100000:1.0:1788201451.130011:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681331328 00000100:00100000:1.0:1788201451.130078:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201451.130089:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681331328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201451.130125:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201451.130182:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681331328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.130191:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788201451.130236:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8333d500 x1875064681331328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201451.130257:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681331328:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788201451.372871:0:19626:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201451.373178:0:19626:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201451.383221:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201451.510787:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201431/real 1788201431] req@ffff9ce0bf6a8000 x1875064681318784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201451 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201451.510825:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf6a8000 x1875064681318784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201451 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201451.510837:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201431/real 1788201431] req@ffff9ce0bf6a8380 x1875064681318912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201451 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201451.510848:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf6a8380 x1875064681318912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201451 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201451.510872:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201451.510890:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201451.510895:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681318784:0@lo:8:kworker.0 00000100:00080000:3.0:1788201451.510902:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201451.510921:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201451.510924:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681318912:0@lo:8:kworker.0 00000100:00080000:2.0:1788201451.510969:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1788201451.510971:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681331456:0@lo:400:kworker.0 00000100:00080000:2.0:1788201451.510973:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201451.510977:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201451.510982:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1788201451.510988:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201451.510996:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cdf821da800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201451.511018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8333df80 x1875064681331712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201451.511030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201451.511032:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788201451.511034:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201451.511037:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1788201451.511039:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201451.511049:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce083419000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201451.511059:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201451.511060:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8333d180 x1875064681331840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201451.511091:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201451.511093:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788201451.511095:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201451.511099:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce0bf443000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201451.511107:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201451.511108:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8333e300 x1875064681332224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201451.511113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681331584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.511142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201451.511162:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681332352:0@lo:400:kworker.0 00000100:00100000:2.0:1788201451.511163:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681332480:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.511189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201451.511192:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681331712:0@lo:8:kworker.0 00000100:00100000:3.0:1788201451.511209:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681332864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201451.511222:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201451.511243:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681331840:0@lo:8:kworker.0 00000100:00100000:2.0:1788201451.511268:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201451.511302:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681332224:0@lo:8:kworker.0 00000100:00100000:2.0:1788201451.511324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.511793:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681331968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.511841:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.511865:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681332608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.511890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.511913:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201451.511919:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681332096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.511956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.511975:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681332736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.511998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.512038:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681331584 00000100:00100000:1.0:1788201451.512046:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681331584 00000100:00100000:1.0:1788201451.512089:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681332096 00000100:00100000:1.0:1788201451.512092:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681332096 00000100:00100000:1.0:1788201451.512108:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201451.512118:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681331584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.512178:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681331584:12345-0@lo:400:kworker.0 Request processed in 60us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.512185:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201451.512202:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201451.512208:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681332096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.512240:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681332096:12345-0@lo:400:kworker.0 Request processed in 32us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.512247:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201451.512267:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681332352 00000100:00100000:1.0:1788201451.512270:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681332352 00000100:00100000:1.0:1788201451.512289:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681331968 00000100:00100000:1.0:1788201451.512292:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681331968 00000100:00100000:1.0:1788201451.512302:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681332608 00000100:00100000:1.0:1788201451.512311:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681332608 00000100:00100000:1.0:1788201451.512326:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681332736 00000100:00100000:1.0:1788201451.512328:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681332736 00000100:00100000:1.0:1788201451.512459:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201451.512466:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681332352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.512705:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681332352:12345-0@lo:400:kworker.0 Request processed in 34us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.512712:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201451.512726:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201451.512731:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681331968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.512790:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681331968:12345-0@lo:400:kworker.0 Request processed in 59us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.512796:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201451.512806:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201451.512812:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681332608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.512835:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681332608:12345-0@lo:400:kworker.0 Request processed in 24us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.512840:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201451.512848:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201451.512853:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681332736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.512878:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681332736:12345-0@lo:400:kworker.0 Request processed in 25us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201451.512879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.512883:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201451.512893:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681332864 00000100:00100000:1.0:1788201451.512897:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681332864 00000100:00100000:1.0:1788201451.512913:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201451.512918:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681332864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.512920:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681331584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.512966:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681332864:12345-0@lo:400:kworker.0 Request processed in 48us (87us total) trans 0 rc 0/0 00010000:00080000:3.0:1788201451.512968:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333f800 x1875064681332352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201451.512973:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201451.512980:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681332352:0@lo:400:kworker.0 00010000:00080000:3.0:1788201451.512992:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333d880 x1875064681332864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201451.513000:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681332864:0@lo:400:kworker.0 00000100:00080000:1.0:1788201451.513006:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201451.513010:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201451.513024:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681331456 00000100:00100000:1.0:1788201451.513027:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681332096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.513028:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681331456 00010000:00080000:1.0:1788201451.513037:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333c000 x1875064681332736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201451.513046:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681332736:0@lo:400:kworker.0 00010000:00080000:1.0:1788201451.513055:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333ca80 x1875064681331968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201451.513060:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201451.513063:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681331968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.513066:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:3646:x1875064681331456:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788201451.513073:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333d500 x1875064681332608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201451.513081:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681332608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.513101:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:3646:x1875064681331456:12345-0@lo:400:kworker.0 Request processed in 35us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201451.513107:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201451.513148:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681331456:0@lo:400:kworker.0 00000100:00100000:2.0:1788201451.513260:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681331712 00000100:00100000:2.0:1788201451.513266:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681331712 00000100:00100000:2.0:1788201451.513301:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681331840 00000100:00100000:2.0:1788201451.513305:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681331840 00000100:00100000:2.0:1788201451.513314:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681332224 00000100:00100000:2.0:1788201451.513317:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681332224 00000100:00100000:2.0:1788201451.513326:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201451.513331:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681331712:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788201451.513374:0:18747:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:2.0:1788201451.513584:0:18747:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee447216b2 00002000:00100000:2.0:1788201451.513603:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cdf8348c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788201451.513609:0:18747:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788201451.513612:0:18747:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201451.513711:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788201451.513761:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201451.513891:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681331712:12345-0@lo:8:kworker.0 Request processed in 557us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201451.513898:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201451.513913:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201451.513918:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681331840:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788201451.514094:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333df80 x1875064681331712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201451.514105:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201451.514114:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788201451.514124:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201451.514129:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788201451.514132:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201451.514150:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201451.514156:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681331712:0@lo:8:kworker.0 00000004:00080000:1.0:1788201451.514230:0:17265:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788201451.514254:0:17265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17265:1875064681333120:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201451.514264:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201451.514271:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875064681332224:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788201451.514316:0:18747:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:2.0:1788201451.514339:0:18747:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee447216b9 00000100:00100000:1.0:1788201451.514495:0:17265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1788201451.514581:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cdf83489800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788201451.514587:0:18747:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788201451.514590:0:18747:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201451.514795:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201451.514819:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201451.514869:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681331840:12345-0@lo:8:kworker.0 Request processed in 949us (3599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201451.514877:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201451.515048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201451.515095:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681332992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201451.515126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788201451.515183:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333d180 x1875064681331840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201451.515207:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201451.515215:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788201451.515222:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201451.515227:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788201451.515229:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201451.515245:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201451.515250:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681331840:0@lo:8:kworker.0 00000100:00100000:1.0:1788201451.515341:0:17265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201451.515495:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681332992 00000100:00100000:1.0:1788201451.515869:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681332992 00000100:00100000:1.0:1788201451.515942:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201451.515953:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681332992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201451.515977:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201451.516030:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681332992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.516037:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:1.0:1788201451.516064:0:17266:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201451.516162:0:17266:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 531813422553ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201451.516170:0:17266:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1788201451.517641:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201451.517671:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681332480 00000100:00100000:1.0:1788201451.517681:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681332480 00000100:00100000:1.0:1788201451.517756:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201451.517767:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681332480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.517909:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681332480:12345-0@lo:400:kworker.0 Request processed in 143us (2860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.517918:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788201451.518107:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf841c5c00 x1875064681332992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201451.518134:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681332992:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788201451.518150:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333fb80 x1875064681332480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201451.518160:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681332480:0@lo:400:kworker.0 00000100:00100000:2.0:1788201451.518203:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681333120 00000100:00100000:2.0:1788201451.518207:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681333120 00000100:00100000:2.0:1788201451.518242:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201451.518249:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17265:x1875064681333120:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788201451.519153:0:17264:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201451.519257:0:17264:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 531816517972ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788201451.519266:0:17264:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:3.0:1788201451.519340:0:18746:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1788201451.519375:0:18746:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee447216c0 00002000:00100000:3.0:1788201451.519392:0:18746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9cdf834e0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788201451.519397:0:18746:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788201451.519400:0:18746:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201451.519451:0:18746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788201451.519486:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9cdf834e5800 : changing import state from RECOVER to FULL 00000004:00080000:1.0:1788201451.521599:0:17220:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788201451.522131:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681332224:12345-0@lo:8:kworker.0 Request processed in 7851us (10798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201451.522147:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:3.0:1788201451.522258:0:17267:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788201451.522289:0:17267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17267:1875064681333376:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788201451.522337:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201451.522367:0:17267:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201451.524083:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201451.524110:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681333248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201451.524180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201451.524239:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681333376 00002000:00080000:2.0:1788201451.524248:0:18747:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000100:00100000:3.0:1788201451.524249:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681333376 00002000:00080000:2.0:1788201451.524257:0:18747:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788201451.524263:0:18747:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:3.0:1788201451.524309:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201451.524320:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17267:x1875064681333376:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201451.525682:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681333248 00000100:00100000:1.0:1788201451.525693:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681333248 00000100:00100000:1.0:1788201451.525773:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201451.525783:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681333248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201451.525839:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:1.0:1788201451.525956:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681333248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.525965:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788201451.527212:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b94c7b80 x1875064681333248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201451.527245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681333248:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201451.527292:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201451.528212:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333e300 x1875064681332224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201451.528232:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788201451.528243:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201451.528252:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788201451.528256:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201451.528291:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201451.528299:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681332224:0@lo:8:kworker.0 00000004:00080000:1.0:1788201451.529318:0:17984:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788201451.529385:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201451.529404:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681333504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201451.529489:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.529553:0:17984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17984:1875064681333632:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788201451.529582:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.529600:0:17984:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce084dd6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201451.529940:0:18746:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788201451.529950:0:18746:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788201451.530077:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681333504 00000100:00100000:1.0:1788201451.530086:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681333504 00000100:00100000:1.0:1788201451.530145:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201451.530156:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875064681333504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201451.530185:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:1.0:1788201451.530263:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875064681333504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.530271:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788201451.530305:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201451.530432:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf841c6300 x1875064681333504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201451.530457:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681333504:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788201451.530517:0:17220:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788201451.530576:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681333632 00000100:00100000:1.0:1788201451.530581:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681333632 00000100:00100000:1.0:1788201451.530951:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201451.530960:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17984:x1875064681333632:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788201451.532967:0:17983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201451.533098:0:17983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 531830358384ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201451.533107:0:17983:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788201451.537012:0:17973:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788201451.541481:0:18748:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788201451.541497:0:18748:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788201451.541505:0:18748:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:2.0:1788201451.546831:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.546855:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.546876:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.546882:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.546890:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.546910:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.546922:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.546940:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.546968:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.546983:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.546990:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.547009:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.547015:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.547025:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.547055:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.547081:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee447216c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.547101:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.547104:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.547106:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.550204:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.553012:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.553049:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.553056:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.553066:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.553090:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.553105:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.553114:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788201451.553181:0:19636:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00010000:00010000:2.0:1788201451.553195:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788201451.553208:0:19636:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00010000:00010000:2.0:1788201451.553218:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.553227:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.553237:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.553243:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.553253:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.553277:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.553286:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee447216ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.553314:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17984:x1875064681333632:12345-0@lo:7:osp-pre-1-1.0 Request processed in 22350us (23725us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201451.553316:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.553320:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.553324:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.553332:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788201451.553386:0:17984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf841c6a00 x1875064681333632/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201467 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201451.553401:0:17984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17984:1875064681333632:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788201451.553415:0:17984:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788201451.553454:0:17984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17984:1875064681333760:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788201451.553487:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201451.553509:0:17984:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201451.553527:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681333760 00000100:00100000:0.0:1788201451.553533:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681333760 00000100:00100000:0.0:1788201451.553575:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201451.553584:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17984:x1875064681333760:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788201451.553608:0:18746:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788201451.553638:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17984:x1875064681333760:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.553644:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788201451.553668:0:17984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf695180 x1875064681333760/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201467 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201451.553678:0:17984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17984:1875064681333760:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788201451.553686:0:17984:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788201451.553707:0:17984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17984:1875064681333888:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788201451.553727:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201451.553771:0:17984:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201451.553783:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681333888 00000100:00100000:0.0:1788201451.553786:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681333888 00000100:00100000:0.0:1788201451.553802:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201451.553811:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17984:x1875064681333888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788201451.553837:0:18746:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1788201451.555599:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.555614:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.555638:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.555652:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.555660:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.555678:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.555689:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.555697:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.555726:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201451.556583:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.556593:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556610:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.556614:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.556620:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556633:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556643:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556661:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556680:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201451.556693:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201451.556700:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556709:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.556714:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556725:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556770:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556779:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee447216d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556798:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.556802:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556821:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.556826:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556835:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556847:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556855:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee447216dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.556868:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.556870:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.556872:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.560111:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.560130:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560154:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.560160:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.560168:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560186:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560208:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560217:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560241:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.560256:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.560262:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560271:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.560276:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560286:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560307:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560315:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee447216e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.560336:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.560344:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.560347:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.560496:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201451.562792:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201451.562804:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562821:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=531s v=(0 0) 00010000:00010000:0.0:1788201451.562826:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201451.562832:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562848:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562860:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562869:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562892:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201451.562903:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201451.562909:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562940:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367da00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201451.562945:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562964:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562985:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.562993:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b9807a/0xf9b71aee447216ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.563021:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.563044:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.563046:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.563905:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.563919:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.563951:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.563963:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.563969:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.563989:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.564002:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.564010:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201451.564284:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201451.564293:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.564308:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=531s v=(0 0) 00010000:00010000:0.0:1788201451.564313:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201451.564319:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.564342:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.564357:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201451.564360:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.564371:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.564373:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.564385:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.564397:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201451.564398:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.564405:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.564412:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.564419:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.564439:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.564460:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee447216f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.564480:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.564482:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.564485:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.564947:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.565025:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201451.565029:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.565039:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.565057:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.565064:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073fb5287/0xf9b71aee447216f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.565083:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.565093:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.565095:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.566004:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.566016:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566033:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.566037:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.566044:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566057:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566067:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566074:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566097:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.566112:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.566124:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566134:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.566139:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566148:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566165:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566173:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee447216ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.566188:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.566190:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.566191:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.567854:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.567868:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.567889:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.567894:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.567902:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.567943:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.567955:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.567963:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.567993:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.568011:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.568018:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.568026:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.568032:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.568042:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.568061:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.568070:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721706 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.568103:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.568105:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.568107:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201451.570656:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201451.570686:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.570706:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=531s v=(0 0) 00010000:00010000:0.0:1788201451.570711:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201451.570719:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.570736:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.570833:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.570842:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.571411:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.571582:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.571596:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.571611:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.571617:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.571629:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.572182:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.572197:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb3781a1/0xf9b71aee4472170d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.572767:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.572772:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.572775:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.573034:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.573045:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.573078:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.573083:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.573091:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.573107:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.573117:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.573124:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.573146:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.573159:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.573165:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.573175:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.573179:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.573189:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.573983:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.574000:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee44721714 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.574020:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.574023:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.574025:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.574102:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.574110:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.574123:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.574126:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.574132:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.574145:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.574154:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.574162:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.574205:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201451.574426:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201451.574434:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.574444:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201451.574448:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.574468:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.574485:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.574493:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000240eb7f2/0xf9b71aee4472171b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.574507:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.576385:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.576389:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.578637:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.578653:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578685:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.578691:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.578699:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578717:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578733:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578758:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578778:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.578799:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.578806:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578816:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.578828:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578839:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578858:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578867:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721722 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.578886:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.578888:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.578890:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201451.581366:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201451.581381:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.581405:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=531s v=(0 0) 00010000:00010000:0.0:1788201451.581410:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201451.581418:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.581437:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.581450:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.581466:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.581489:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201451.581502:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1788201451.581793:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.581801:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.581811:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.581814:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.581818:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.581830:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.581837:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.581850:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.581867:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.581876:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201451.582835:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.582855:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201451.582861:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.582872:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.582893:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.582900:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073fb5287/0xf9b71aee44721729 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.582918:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.582921:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.582922:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.588847:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.588861:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.588882:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.588887:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.588896:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.588915:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.588927:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.588948:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.588970:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.588983:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1788201451.589168:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.589176:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.589186:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.589189:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.589193:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.589204:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.589212:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.589219:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.589229:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201451.590752:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.590776:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.590794:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.590799:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.590805:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.590819:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.590829:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.590837:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.590848:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201451.590870:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590880:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.590885:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590906:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590926:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590945:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000720f174d/0xf9b71aee44721737 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590962:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201451.590966:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590972:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.590975:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590981:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590991:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.590997:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee4472173e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.591020:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.591023:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.591029:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.591032:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.591039:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.591050:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.591057:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721745 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.591067:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.591068:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.591070:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.600140:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.600148:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.600150:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.600707:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.600729:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.600752:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.600767:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.600807:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.600816:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9801e0d/0xf9b71aee44721730 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.600840:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.600842:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.600844:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.601761:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.601776:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.601793:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.601797:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.601805:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.601818:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.601827:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.601834:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.601871:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.601884:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.601890:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.601898:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.601903:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.601912:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.601927:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.606610:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002db79017/0xf9b71aee4472174c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.606646:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.606648:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.606651:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.617004:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.617022:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.617058:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.617064:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.617073:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.617090:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.617102:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.617111:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.617132:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201451.619835:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.619853:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.619875:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.619887:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.619895:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.619913:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.619949:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.619959:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620001:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201451.620014:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201451.620022:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620032:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.620038:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620069:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620091:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620109:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8ff9771/0xf9b71aee44721753 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620127:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.620131:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620137:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.620141:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620149:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620159:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620166:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79017/0xf9b71aee4472175a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620177:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.620179:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.620179:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.620181:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.620185:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.620193:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.620197:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.620201:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.620210:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.620230:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.620237:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.620250:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1788201451.620322:0:19559:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788201451.620341:0:19559:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788201451.620353:0:19559:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788201451.620374:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.620379:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620388:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.620391:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620399:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620412:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620419:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000720f174d/0xf9b71aee44721761 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.620431:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.620433:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.620434:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201451.620604:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17984:x1875064681333888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 66792us (66872us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788201451.620615:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:1.0:1788201451.620978:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.620984:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621007:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.621010:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.621016:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621026:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621034:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621041:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621055:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.621064:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.621068:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621076:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.621080:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621089:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621113:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621121:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9801e0d/0xf9b71aee44721768 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621136:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.621138:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.621140:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.621180:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.621185:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621194:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.621197:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.621201:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621211:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621219:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621227:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621252:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.621261:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.621264:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621271:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.621274:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621283:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621294:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621301:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b14961d/0xf9b71aee4472176f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.621313:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.621314:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.621316:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.621323:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.621562:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.621569:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621577:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.621580:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.621585:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621593:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621601:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621608:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621632:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.621639:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.621643:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621649:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.621652:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621660:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621670:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621676:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed0bc3ac/0xf9b71aee44721776 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.621689:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.621691:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.621692:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.623243:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.623256:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623290:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.623295:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.623303:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623317:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623327:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623335:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623417:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.623430:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.623435:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623444:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.623450:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623459:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623490:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.623498:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063e3b2a/0xf9b71aee4472177d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.623825:0:17984:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788201451.623846:0:17984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17984:1875064681333888:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788201451.623866:0:17984:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788201451.623942:0:17984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17984:1875064681334016:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788201451.624018:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201451.624057:0:17984:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201451.624152:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681334016 00000100:00100000:0.0:1788201451.624161:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681334016 00000100:00100000:0.0:1788201451.624353:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201451.624365:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17984:x1875064681334016:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788201451.624376:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.624378:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.624380:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.624429:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17984:x1875064681334016:12345-0@lo:900:osp-pre-1-1.0 Request processed in 66us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.624436:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788201451.624487:0:17984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf695180 x1875064681334016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201467 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201451.624499:0:17984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17984:1875064681334016:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788201451.625880:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.625895:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.625915:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.625919:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.625926:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.625953:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.625964:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201451.625965:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.625971:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.625973:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.625980:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.625989:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.625994:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626003:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.626005:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.626011:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626017:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626030:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201451.626039:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201451.626046:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626055:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.626059:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626069:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626088:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626105:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013253b1f/0xf9b71aee44721784 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626123:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.626126:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626132:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.626136:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626142:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626153:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626159:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472178b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.626171:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.626173:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.626175:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.627259:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.627340:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.627360:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.627378:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.627382:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.627388:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.627400:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.627410:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.627417:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.627439:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201451.627859:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.627867:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.627883:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.627887:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.627891:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.627902:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.627907:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.627910:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.627916:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.627918:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.627941:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.627941:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201451.627946:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.627948:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.627952:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.627956:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.627959:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.627963:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.627968:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.627976:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.627985:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5ad480a/0xf9b71aee44721792 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.627989:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.627996:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.628003:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.628004:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.628006:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.628008:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.628009:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.628011:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.628310:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.628316:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.628325:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.628333:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.628338:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.628359:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.628367:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.628374:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.628394:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201451.628622:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.628629:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.628639:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.628643:0:19639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.628653:0:19639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.628685:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.628693:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008989b8c/0xf9b71aee447217a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.628711:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.628714:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.628716:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.629044:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.629052:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629064:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.629067:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.629073:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629084:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629093:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629107:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629128:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201451.629355:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.629362:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.629370:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.629374:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.629381:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.629394:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.629401:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee447217a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.629427:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.629429:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.629431:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.629618:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.629624:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629633:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.629637:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.629641:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629650:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629658:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629814:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.629837:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201451.630018:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.630023:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630032:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.630036:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630045:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630059:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630067:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2029aa4/0xf9b71aee447217ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630080:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.630081:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.630082:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.630301:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.630307:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.630325:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.630328:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.630333:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.630352:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.630361:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.630368:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.630380:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201451.630808:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201451.630815:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630835:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1788201451.630839:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201451.630843:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630854:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630862:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630869:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.630885:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201451.631007:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201451.631013:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631022:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aee00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.631026:0:19639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631035:0:19639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631058:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631066:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee447217b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631082:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.631086:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631092:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.631095:0:19639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631103:0:19639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631113:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631121:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab98fd63/0xf9b71aee447217bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.631134:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.631136:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.631142:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.631294:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201451.631654:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788201451.631791:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.631798:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631811:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.631815:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.631821:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631832:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631849:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631857:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631873:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.631883:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.631888:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631896:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afa00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.631900:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631909:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631923:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631942:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447217ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.631960:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.631966:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.631968:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.632140:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.632151:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1788201451.632154:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201451.632159:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.632170:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.632179:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.632187:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.632205:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201451.632645:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201451.632652:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.632662:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=531s v=(0 0) 00002000:00010000:2.0:1788201451.632922:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.632938:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.632947:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.632950:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.632954:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.632964:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.632973:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.632980:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.632993:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201451.633001:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201451.633007:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633015:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.633018:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633038:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633052:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633060:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032601dfc/0xf9b71aee447217c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633077:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.633080:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633086:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.633090:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633097:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633106:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633113:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.633135:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.633137:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.633139:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.633261:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.633363:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201451.633368:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.633390:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.633399:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.633406:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.635797:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201451.635819:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.635830:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.635846:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.635851:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.635864:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.635888:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.635895:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc6af42e/0xf9b71aee447217d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.635926:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.637891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201451.637920:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681334144:0@lo:41:osp-pre-0-1.0 00002000:00010000:2.0:1788201451.638272:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.638284:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638302:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.638307:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.638314:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638329:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638339:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638358:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638378:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.638391:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.638397:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638424:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.638429:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638439:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638458:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638466:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee447217df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.638484:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.638486:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.638487:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.639269:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.639279:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639298:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.639302:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.639307:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639317:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639331:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639348:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639366:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201451.639878:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.639887:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639898:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.639902:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.639907:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639919:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639938:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639947:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.639980:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201451.639993:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201451.639999:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640008:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.640013:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640024:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640041:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640049:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447217e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640069:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.640072:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640079:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afc00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.640082:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640102:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640114:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640122:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447217ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640137:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.640139:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.640140:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.640441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201451.640663:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.640679:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.640686:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681334272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201451.640727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201451.640815:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681334144 00000100:00100000:0.0:1788201451.640823:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681334144 00000100:00100000:0.0:1788201451.640863:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681334272 00000100:00100000:0.0:1788201451.640865:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681334272 00002000:00010000:2.0:1788201451.640869:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.640878:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.640890:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788201451.640896:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.640905:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1788201451.640906:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681334144:12345-0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788201451.640914:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640941:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640954:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.640971:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000024:0.0:1788201451.640978:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00010000:00010000:2.0:1788201451.640989:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.641001:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.641008:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.641018:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aea00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.641023:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.641033:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.641043:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681334144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (608us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201451.641049:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.641059:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788201451.641070:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447217f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.641094:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1788201451.641095:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.641099:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.641101:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.641109:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.641332:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681334272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201451.641353:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788201451.641386:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681334272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.641393:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201451.641455:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681334272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201451.641473:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681334144:0@lo:41:osp-pre-0-1.0 00002000:00010000:2.0:1788201451.643170:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.643182:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.643202:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.643207:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.643214:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.643236:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.643247:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.643254:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.643285:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201451.643489:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.643640:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.643652:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.643658:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.644547:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.644574:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.644583:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e873bdf/0xf9b71aee447217fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.644609:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.644611:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.644613:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.645327:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.645337:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.645364:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.645369:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.645376:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.645403:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.645413:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.645421:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.645448:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201451.645697:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201451.645713:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.645727:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afa00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201451.645732:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.645778:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.645805:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.645845:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee44721802 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201451.645886:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.645889:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201451.645894:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.646251:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.646261:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646276:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.646279:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.646285:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646296:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646305:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646323:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646351:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.646364:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.646370:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646379:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.646384:0:19639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646393:0:19639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646410:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646418:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13c8c87/0xf9b71aee44721809 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.646433:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.646435:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.646437:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788201451.646496:0:18747:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1788201451.646629:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17265:x1875064681333120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 128374us (132129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201451.646646:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201451.647068:0:17265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17265:1875064681333120:0@lo:5:osp-pre-0-0.0 00002000:00010000:3.0:1788201451.647308:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201451.647317:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201451.647352:0:17265:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00010000:00010000:3.0:1788201451.647364:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1788201451.647370:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201451.647378:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.647391:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.647400:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.647410:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.647416:0:17265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17265:1875064681334400:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788201451.647443:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201451.647456:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.647463:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.647472:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.647476:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.647485:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.647495:0:17265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201451.647611:0:17265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571d0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788201451.647636:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.647645:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc6af42e/0xf9b71aee44721810 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201451.647700:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681334400 00000100:00100000:0.0:1788201451.647708:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681334400 00010000:00010000:3.0:1788201451.647810:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.647814:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.647815:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.647916:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201451.647941:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17265:x1875064681334400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201451.647987:0:19636:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:3.0:1788201451.648861:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201451.648873:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.648891:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1788201451.648896:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201451.648903:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.648921:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.648945:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.648954:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.649039:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.649244:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.649253:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.649262:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.649267:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.649277:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.649295:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.649302:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382ed697/0xf9b71aee44721817 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.649322:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.649323:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.649325:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201451.650642:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201451.650655:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.650756:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1788201451.650762:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201451.650769:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.650783:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.650792:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.650800:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.650818:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.651184:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.651194:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.651215:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080030a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.651219:0:19639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.651240:0:19639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.651258:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.651266:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d0e9a89/0xf9b71aee4472181e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.651286:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.651287:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.651290:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.651875:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.651884:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.651899:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.651903:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.651909:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.651924:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.651946:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.651953:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.655411:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201451.655799:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.655811:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.655864:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.655870:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.655884:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.655909:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.655918:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000240eb7f2/0xf9b71aee44721825 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.655953:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.655955:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.655957:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201451.656040:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.656049:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.656064:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1788201451.656077:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201451.656085:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.656100:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.656108:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.656116:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.656130:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201451.658153:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201451.658166:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.658183:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201451.658188:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.658200:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.658224:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.658248:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6496588/0xf9b71aee4472182c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.658270:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.658272:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.658274:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201451.659065:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.659078:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.659094:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.659099:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.659106:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.659121:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.659132:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.659139:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.659973:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1788201451.660418:0:18742:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788201451.660477:0:18742:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788201451.660823:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17265:x1875064681334400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12890us (13322us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788201451.660845:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788201451.660894:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.660909:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.660924:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.660950:0:19639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.660962:0:19639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.660985:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.660993:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13c8c87/0xf9b71aee44721833 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.661019:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.661024:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.661027:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201451.661075:0:17265:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788201451.661086:0:17265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17265:1875064681334400:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201451.661105:0:17265:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:2.0:1788201451.661879:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201451.661892:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.661911:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.661916:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.661923:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.661950:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.661960:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.661969:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.661990:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201451.663657:0:18748:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201451.663954:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201451.663968:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.663986:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aea00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201451.663992:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.664022:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.664047:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.664056:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee4472183a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201451.664078:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.664080:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201451.664082:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201451.664532:0:18748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.664548:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1788201451.664553:0:18748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201451.664568:0:18748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.664583:0:18748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.664593:0:18748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.664602:0:18748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201451.664691:0:18748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788201451.664827:0:18748:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:3.0:1788201451.664923:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201451.664949:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.664964:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afc00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201451.664970:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201451.664984:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17267:x1875064681333376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 140659us (142640us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201451.664985:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201451.665008:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788201451.665021:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.665040:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee44721841 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201451.665067:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201451.665071:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201451.665073:0:17267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17267:1875064681333376:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788201451.665076:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201451.665102:0:17267:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788201451.665166:0:17267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17267:1875064681334528:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201451.665239:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.665276:0:17267:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0862d9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201451.665805:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681334528 00000100:00100000:2.0:1788201451.665814:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681334528 00000100:00100000:2.0:1788201451.665868:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201451.665878:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17267:x1875064681334528:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788201451.665937:0:18746:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1788201451.671639:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17267:x1875064681334528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5682us (6321us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788201451.671652:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201451.676459:0:17267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17267:1875064681334528:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201451.676486:0:17267:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1788201452.405915:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201452.406333:0:17237:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201452.406338:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b3251800 from 10 10000000:01000000:0.0:1788201452.406345:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201452.406408:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201452.406437:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201452.406452:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201452.406486:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681334656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201452.406578:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201452.406634:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201452.407086:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681334656 00000100:00100000:3.0:1788201452.407095:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681334656 00000100:00100000:3.0:1788201452.407154:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788201452.407165:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:17237:x1875064681334656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201452.407181:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201452.407209:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce080031e00/0xf9b71aee4472184f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721848 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201452.407346:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce080031e00/0xf9b71aee4472184f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721848 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201452.407360:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce080031e00/0xf9b71aee4472184f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721848 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201452.407372:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce080031e00, rc 0) 00000100:00100000:3.0:1788201452.409551:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681334656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2377us (2962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201452.409567:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201452.416016:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681334656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201452.416056:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.416073:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201452.418095:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681334784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201452.418195:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201452.418266:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a00ec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201452.418296:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681334784 00000100:00100000:2.0:1788201452.418304:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681334784 00000100:00100000:2.0:1788201452.418365:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201452.418376:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681334784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201452.418404:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201452.418424:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201452.418428:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788201452.418528:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681334784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201452.418537:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201452.418593:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681334784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201452.418666:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201452.418678:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.418691:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201452.418703:0:17237:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201452.418707:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0ba1d3800 from 10 10000000:01000000:2.0:1788201452.418710:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201452.418764:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.418909:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.418921:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201452.418945:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681334912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201452.418975:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201452.419005:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a00ec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201452.419020:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681334912 00000100:00100000:2.0:1788201452.419024:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681334912 00000100:00100000:2.0:1788201452.419061:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788201452.419070:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681334912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201452.419081:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201452.419097:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03aec00/0xf9b71aee4472185d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721856 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.419121:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03aec00/0xf9b71aee4472185d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721856 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.419132:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03aec00/0xf9b71aee4472185d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721856 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.419143:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03aec00, rc 0) 00000100:00100000:2.0:1788201452.419172:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:17237:x1875064681334912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201452.419179:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788201452.419218:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681334912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201452.419611:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.419622:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201452.419670:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681335040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201452.419703:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201452.419727:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a00ec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201452.420327:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681335040 00000100:00100000:1.0:1788201452.420335:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681335040 00000100:00100000:1.0:1788201452.420383:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201452.420392:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:17237:x1875064681335040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201452.420423:0:17235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201452.420439:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201452.420442:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788201452.420547:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:17237:x1875064681335040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201452.420555:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788201452.420894:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681335040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201452.421063:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201452.421072:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201452.421083:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201452.599473:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788201453.430197:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201454.456697:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201455.479700:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201456.246444:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681335168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201456.246544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201456.247063:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681335168 00000100:00100000:2.0:1788201456.247074:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681335168 00000100:00100000:2.0:1788201456.247163:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201456.247174:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681335168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201456.247211:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788201456.247276:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681335168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201456.247284:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201456.247341:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681335168:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201456.247441:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201456.502407:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201456.758084:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681335296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201456.758175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.758271:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681335296 00000100:00100000:0.0:1788201456.758280:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681335296 00000100:00100000:0.0:1788201456.758330:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201456.758340:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681335296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201456.758457:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788201456.758579:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681335296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 239us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.758588:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201456.758642:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681335296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201456.759089:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681335424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.759138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201456.759170:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681335936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.759195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201456.759212:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681336448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.759232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201456.759263:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201456.759269:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681335552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.759290:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201456.759294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.759299:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681336960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201456.759310:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681336064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.759331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.759331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201456.759347:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681336576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.759360:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681336064 00000100:00100000:0.0:1788201456.759366:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681336064 00000100:00100000:2.0:1788201456.759368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201456.759394:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681335424 00000100:00100000:2.0:1788201456.759398:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681335424 00000100:00100000:2.0:1788201456.759431:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788201456.759439:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681335424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.759483:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681335936 00000100:00100000:2.0:1788201456.759483:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681335424:12345-0@lo:400:kworker.0 Request processed in 44us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201456.759488:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681335936 00000100:00100000:2.0:1788201456.759489:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788201456.759532:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681335424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.759595:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681336448 00000100:00100000:3.0:1788201456.759598:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681336448 00000100:00100000:3.0:1788201456.759619:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681336576 00000100:00100000:3.0:1788201456.759622:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681336576 00000100:00100000:3.0:1788201456.759637:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201456.759643:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681335936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.759686:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681335936:12345-0@lo:400:kworker.0 Request processed in 43us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201456.759692:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201456.759705:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201456.759710:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681336448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.759736:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681336448:12345-0@lo:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201456.759766:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201456.759777:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201456.759783:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681336576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.759808:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681336576:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201456.759814:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788201456.759847:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333e300 x1875064681336576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201456.759859:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681336576:0@lo:400:kworker.0 00010000:00080000:3.0:1788201456.759869:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333c700 x1875064681335936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201456.759891:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681335936:0@lo:400:kworker.0 00010000:00080000:3.0:1788201456.759921:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333fb80 x1875064681336448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201456.759929:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681336448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760043:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201456.760059:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681336064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760098:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681336064:12345-0@lo:400:kworker.0 Request processed in 41us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.760104:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201456.760135:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681336960 00000100:00100000:0.0:1788201456.760139:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681336960 00000100:00100000:0.0:1788201456.760166:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201456.760173:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681336960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201456.760190:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788201456.760195:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201456.760201:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201456.760203:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201456.760221:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681336960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.760227:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201456.760268:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681335680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760296:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.760323:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681336192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760343:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.760356:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681336704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.760582:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681337216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201456.760605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.760627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788201456.760632:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681335808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760659:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.760676:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681336320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760697:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201456.760719:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681337088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201456.760723:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681336832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201456.760771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.760781:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681337344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201456.760801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201456.760804:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681336960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201456.760823:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681335680 00000100:00100000:0.0:1788201456.760829:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681335680 00000100:00100000:1.0:1788201456.760834:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681335552 00000100:00100000:1.0:1788201456.760838:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681335552 00000100:00100000:0.0:1788201456.760851:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681336192 00000100:00100000:0.0:1788201456.760854:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681336192 00000100:00100000:1.0:1788201456.760855:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681337088 00000100:00100000:1.0:1788201456.760857:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681337088 00000100:00100000:1.0:1788201456.760868:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201456.760871:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681335808 00000100:00100000:0.0:1788201456.760874:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681335808 00000100:00100000:1.0:1788201456.760875:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681335552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760886:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201456.760891:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681335680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.760924:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681335552:12345-0@lo:400:kworker.0 Request processed in 48us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201456.760931:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201456.760933:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681335680:12345-0@lo:400:kworker.0 Request processed in 42us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.760938:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201456.760946:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201456.760948:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201456.760952:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681337088:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201456.760953:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681336192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.760977:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681336192:12345-0@lo:400:kworker.0 Request processed in 25us (634us total) trans 0 rc 0/0 00000004:00000024:1.0:1788201456.760982:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788201456.760982:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201456.760992:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201456.760997:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681335808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.761014:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681337088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201456.761020:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201456.761040:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681335808:12345-0@lo:400:kworker.0 Request processed in 42us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.761046:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201456.761047:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681337088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201456.761063:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681336704 00000100:00100000:0.0:1788201456.761066:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681336704 00000100:00100000:1.0:1788201456.761074:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681336320 00000100:00100000:1.0:1788201456.761076:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681336320 00000100:00100000:1.0:1788201456.761095:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681336832 00000100:00100000:1.0:1788201456.761103:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681336832 00000100:00100000:3.0:1788201456.761522:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681335552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.761536:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681336064:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.762587:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201456.762609:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681336320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.762698:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681336320:12345-0@lo:400:kworker.0 Request processed in 99us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.762705:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201456.762727:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201456.762734:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681336704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.762782:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681336704:12345-0@lo:400:kworker.0 Request processed in 49us (2406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.762788:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201456.762803:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201456.762810:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681336832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.762839:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681336832:12345-0@lo:400:kworker.0 Request processed in 30us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.762844:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788201456.762867:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201456.762873:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201456.762878:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201456.762890:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681337216 00000100:00100000:0.0:1788201456.762909:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681337216 00000100:00100000:0.0:1788201456.762938:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681337344 00000100:00100000:0.0:1788201456.762941:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681337344 00000100:00100000:0.0:1788201456.762953:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201456.762959:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681337216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201456.762986:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201456.763017:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681337216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.763032:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201456.763044:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201456.763050:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681337344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201456.763059:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201456.763082:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681337344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (2281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.763088:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201456.763138:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681335808:0@lo:400:kworker.0 00010000:00080000:0.0:1788201456.763155:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8333ce00 x1875064681336320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201456.763167:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681336320:0@lo:400:kworker.0 00010000:00080000:0.0:1788201456.763179:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf837e7100 x1875064681336832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201456.763188:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681336832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.763203:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681337344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201456.763214:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681335680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.763226:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681336192:0@lo:400:kworker.0 00010000:00080000:0.0:1788201456.763236:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf837e5c00 x1875064681336704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201456.763966:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681336704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.763996:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681337216:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788201457.309401:0:19918:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788201457.529129:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201457.784378:0:19559:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000040:00080000:1.0:1788201458.044640:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788201458.254808:0:19970:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201458.255106:0:19970:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201458.551139:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201459.369272:0:20020:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201459.369985:0:20020:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201459.575327:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201459.718143:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.718249:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662378112 00000100:00100000:2.0:1788201459.718259:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662378112 00000100:00100000:2.0:1788201459.718325:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:2.0:1788201459.718333:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1875064662378112:12345-192.168.203.2@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788201459.718361:0:17233:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from be2ec582-f6a7-44d0-975e-32edaafa1016@192.168.203.2@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:2.0:1788201459.718388:0:17233:0:(genops.c:1406:class_connect()) connect: client be2ec582-f6a7-44d0-975e-32edaafa1016, cookie 0xf9b71aee44721864 00000100:00080000:2.0:1788201459.718528:0:17233:0:(import.c:65:import_set_state_nolock()) ffff9ce0a03a5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201459.718608:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+5:2397:x1875064662378112:12345-192.168.203.2@tcp:250:mount.lustre.0 Request processed in 274us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.718616:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:3.0:1788201459.733257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201459.733365:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662378240 00000100:00100000:1.0:1788201459.733374:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662378240 00000100:00100000:1.0:1788201459.733436:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:1.0:1788201459.733446:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+5:14910:x1875064662378240:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201459.733462:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201459.733479:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472186b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3f3 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.733507:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472186b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3f3 expref: 6 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.733518:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472186b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3f3 expref: 6 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.733553:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254e00, rc 0) 00000100:00100000:1.0:1788201459.733613:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+6:14910:x1875064662378240:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 169us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.733621:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:3.0:1788201459.738526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.738668:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662378368 00000100:00100000:2.0:1788201459.738683:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662378368 00000100:00100000:2.0:1788201459.738906:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:2.0:1788201459.738918:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+6:14910:x1875064662378368:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201459.739103:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+6:14910:x1875064662378368:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 187us (590us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201459.739111:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:3.0:1788201459.746127:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201459.750193:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662378496 00000100:00100000:0.0:1788201459.750207:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662378496 00000100:00100000:0.0:1788201459.750329:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:0.0:1788201459.750340:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+6:14910:x1875064662378496:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201459.750356:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201459.750374:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367ca00/0xf9b71aee44721872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc3fa expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201459.750401:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367ca00/0xf9b71aee44721872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3fa expref: 7 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201459.750412:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367ca00/0xf9b71aee44721872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3fa expref: 7 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201459.750420:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367ca00, rc 0) 00000100:00100000:0.0:1788201459.750490:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+7:14910:x1875064662378496:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 152us (4371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201459.750497:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:3.0:1788201459.756782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201459.756912:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662378624 00000100:00100000:1.0:1788201459.756926:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662378624 00000100:00100000:1.0:1788201459.756998:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:1.0:1788201459.757009:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+7:14910:x1875064662378624:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201459.757173:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14910:x1875064662378624:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 165us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.757183:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:3.0:1788201459.760881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.762364:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662378752 00000100:00100000:2.0:1788201459.762378:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662378752 00000100:00100000:2.0:1788201459.762449:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:2.0:1788201459.762459:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14910:x1875064662378752:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788201459.762611:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14910:x1875064662378752:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 153us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.762619:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:0.0:1788201459.775903:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.776075:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662378880 00000100:00100000:2.0:1788201459.776084:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662378880 00000100:00100000:2.0:1788201459.776143:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:2.0:1788201459.776164:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14928:x1875064662378880:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201459.776532:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14928:x1875064662378880:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 368us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.776541:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:3.0:1788201459.811898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201459.811995:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662379008 00000100:00100000:1.0:1788201459.812010:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662379008 00000100:00100000:1.0:1788201459.812082:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:1.0:1788201459.812093:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14928:x1875064662379008:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201459.812262:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14928:x1875064662379008:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 169us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.812269:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:3.0:1788201459.819148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201459.824618:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662379136 00000100:00100000:0.0:1788201459.824643:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662379136 00000100:00100000:0.0:1788201459.824716:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:0.0:1788201459.824725:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14928:x1875064662379136:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201459.824943:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14928:x1875064662379136:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 218us (5809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201459.824951:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:0.0:1788201459.830021:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.830113:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662379264 00000100:00100000:2.0:1788201459.830122:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662379264 00000100:00100000:2.0:1788201459.830173:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:2.0:1788201459.830184:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+8:14910:x1875064662379264:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788201459.830203:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201459.830220:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03af200/0xf9b71aee44721879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc42b expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.830255:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03af200/0xf9b71aee44721879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc42b expref: 9 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.830266:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03af200/0xf9b71aee44721879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc42b expref: 9 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.830275:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03af200, rc 0) 00000100:00100000:2.0:1788201459.830331:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+9:14910:x1875064662379264:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 149us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.830337:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:3.0:1788201459.832272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201459.832406:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662379392 00000100:00100000:1.0:1788201459.832419:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662379392 00000100:00100000:1.0:1788201459.832483:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:1.0:1788201459.832493:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+9:14910:x1875064662379392:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788201459.832516:0:17235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788201459.832537:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201459.832545:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201459.832549:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788201459.832552:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788201459.832555:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788201459.836383:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+9:14910:x1875064662379392:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 3881us (4125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.836399:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:0.0:1788201459.842493:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.844789:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662379520 00000100:00100000:2.0:1788201459.844803:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662379520 00000100:00100000:2.0:1788201459.844883:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:2.0:1788201459.844894:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+9:14910:x1875064662379520:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788201459.844912:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201459.844942:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc432 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.844973:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 10 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.844984:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 10 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.844992:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03afa00, rc 0) 00000100:00100000:2.0:1788201459.845058:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14910:x1875064662379520:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 166us (2575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.845064:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:2.0:1788201459.850053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201459.853903:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662379648 00000100:00100000:1.0:1788201459.853924:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662379648 00000100:00100000:1.0:1788201459.854095:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:1.0:1788201459.854109:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14910:x1875064662379648:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201459.854346:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14910:x1875064662379648:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 239us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.854356:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:2.0:1788201459.860370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201459.860840:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662379776 00000100:00100000:1.0:1788201459.860854:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662379776 00000100:00100000:1.0:1788201459.860934:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:1.0:1788201459.860946:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14910:x1875064662379776:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201459.861146:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14910:x1875064662379776:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 201us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.861154:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:0.0:1788201459.864359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201459.864439:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662379904 00000100:00100000:1.0:1788201459.864459:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662379904 00000100:00100000:1.0:1788201459.864551:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:1.0:1788201459.864565:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14933:x1875064662379904:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201459.864868:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14933:x1875064662379904:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 306us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.864893:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:0.0:1788201459.872525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.872655:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662380032 00000100:00100000:2.0:1788201459.872666:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662380032 00000100:00100000:2.0:1788201459.872728:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:2.0:1788201459.872774:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14933:x1875064662380032:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201459.872941:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+10:14933:x1875064662380032:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 204us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.872950:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:2.0:1788201459.896040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.896160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201459.905686:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662380160 00000100:00100000:1.0:1788201459.905709:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662380160 00000100:00100000:1.0:1788201459.905792:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662380416 00000100:00100000:1.0:1788201459.905796:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662380416 00000100:00100000:1.0:1788201459.905840:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1788201459.905852:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875064662380160:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788201459.905903:0:17241:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 02286e61-118a-46f7-9134-2c74a0c116ce@192.168.203.2@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1788201459.905979:0:17241:0:(genops.c:1406:class_connect()) connect: client 02286e61-118a-46f7-9134-2c74a0c116ce, cookie 0xf9b71aee44721887 00000004:00100000:1.0:1788201459.906016:0:17241:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788201459.906275:0:17241:0:(import.c:65:import_set_state_nolock()) ffff9cdf831ab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201459.906374:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+6:2397:x1875064662380160:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 521us (10346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.906383:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1788201459.906407:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:1.0:1788201459.906412:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875064662380416:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788201459.906922:0:17241:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 02286e61-118a-46f7-9134-2c74a0c116ce@192.168.203.2@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1788201459.906972:0:17241:0:(genops.c:1406:class_connect()) connect: client 02286e61-118a-46f7-9134-2c74a0c116ce, cookie 0xf9b71aee4472188e 00000004:00100000:1.0:1788201459.906996:0:17241:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788201459.907174:0:17241:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf445800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201459.907215:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+6:2397:x1875064662380416:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 801us (11054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.907223:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:0.0:1788201459.918494:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201459.918540:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201459.918579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.918691:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662380672 00000100:00100000:2.0:1788201459.918703:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662380672 00000100:00100000:2.0:1788201459.918812:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662380544 00000100:00100000:2.0:1788201459.918816:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662380544 00000100:00100000:2.0:1788201459.918855:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662380288 00000100:00100000:2.0:1788201459.918859:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662380288 00000100:00100000:2.0:1788201459.918890:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1788201459.918902:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+7:14910:x1875064662380672:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201459.918953:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788201459.919060:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+7:14910:x1875064662380672:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 161us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.919068:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1788201459.919089:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1788201459.919097:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:0:x1875064662380544:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201459.919116:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201459.919149:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:0:x1875064662380544:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 53us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.919155:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1788201459.919167:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:2.0:1788201459.919174:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:0:x1875064662380288:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201459.919185:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788201459.919207:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:0:x1875064662380288:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 34us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.919213:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00080000:0.0:1788201459.919549:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201459.919555:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201459.927381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.927501:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662380800 00000100:00100000:2.0:1788201459.927514:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662380800 00000100:00100000:2.0:1788201459.927595:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1788201459.927607:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:14910:x1875064662380800:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788201459.927865:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:14910:x1875064662380800:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 260us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.927900:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1788201459.935137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.935190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201459.935292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201459.935406:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662380928 00000100:00100000:0.0:1788201459.935419:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662380928 00000100:00100000:0.0:1788201459.935481:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662381056 00000100:00100000:0.0:1788201459.935484:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662381056 00000100:00100000:0.0:1788201459.935505:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1788201459.935516:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875064662380928:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788201459.935565:0:18746:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 02286e61-118a-46f7-9134-2c74a0c116ce@192.168.203.2@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1788201459.935615:0:18746:0:(genops.c:1406:class_connect()) connect: client 02286e61-118a-46f7-9134-2c74a0c116ce, cookie 0xf9b71aee44721895 00002000:00100000:0.0:1788201459.935630:0:18746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 02286e61-118a-46f7-9134-2c74a0c116ce/ffff9cdf819db000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201459.935653:0:18746:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788201459.935929:0:18746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201459.935968:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9cdf819de000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201459.936087:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:2397:x1875064662380928:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 570us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201459.936097:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1788201459.936120:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1788201459.936126:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875064662381056:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788201459.936149:0:18746:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 02286e61-118a-46f7-9134-2c74a0c116ce@192.168.203.2@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1788201459.936176:0:18746:0:(genops.c:1406:class_connect()) connect: client 02286e61-118a-46f7-9134-2c74a0c116ce, cookie 0xf9b71aee4472189c 00002000:00100000:0.0:1788201459.936183:0:18746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 02286e61-118a-46f7-9134-2c74a0c116ce/ffff9cdf819dd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201459.936198:0:18746:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788201459.936323:0:18746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201459.936340:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9cdf819df800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201459.936367:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:2397:x1875064662381056:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 239us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201459.936374:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:1.0:1788201459.942889:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662381184 00000100:00100000:1.0:1788201459.942933:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662381184 00000100:00100000:1.0:1788201459.943028:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:1.0:1788201459.943042:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02286e61-118a-46f7-9134-2c74a0c116ce+6:14910:x1875064662381184:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788201459.943166:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02286e61-118a-46f7-9134-2c74a0c116ce+6:14910:x1875064662381184:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 127us (7975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.943175:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1788201459.956924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201459.957145:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662381312 00000100:00100000:3.0:1788201459.957160:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662381312 00000100:00100000:3.0:1788201459.957233:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1788201459.957246:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:14910:x1875064662381312:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788201459.966043:0:17243:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8683us 00000004:00200000:3.0:1788201460.012826:0:17243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788201460.013942:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:14910:x1875064662381312:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 56685us (57020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201460.013963:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:0.0:1788201460.188315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201460.188576:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662381440 00000100:00100000:1.0:1788201460.188589:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662381440 00000100:00100000:1.0:1788201460.188674:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:1.0:1788201460.188687:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+6:14956:x1875064662381440:12345-192.168.203.2@tcp:101:mkdir.0 00010000:00010000:1.0:1788201460.188716:0:19574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201460.188789:0:19574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447218a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc463 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201460.188896:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447218aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201460.188913:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447218aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201460.188929:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447218aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201460.188999:0:19574:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201460.189004:0:19574:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201460.189043:0:19574:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447218aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201460.189075:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254000/0xf9b71aee447218a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc463 expref: 8 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201460.189116:0:19574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447218aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc463 expref: 7 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201460.189127:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc100) 00010000:00010000:1.0:1788201460.189131:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201460.189135:0:19574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255e00, rc 0) 00000100:00100000:1.0:1788201460.189225:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+7:14956:x1875064662381440:12345-192.168.203.2@tcp:101:mkdir.0 Request processed in 537us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201460.189233:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00010000:00010000:0.0:1788201460.599222:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201461.368894:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201461.368947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681337472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201461.369047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201461.369147:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681337472 00000100:00100000:3.0:1788201461.369162:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681337472 00000100:00100000:3.0:1788201461.369257:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201461.369270:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681337472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201461.369304:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788201461.369364:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201461.369367:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681337472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.369377:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201461.369435:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681337472:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201461.622098:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201461.878065:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681337600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201461.878170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201461.878555:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681337600 00000100:00100000:1.0:1788201461.878569:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681337600 00000100:00100000:1.0:1788201461.878636:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201461.878647:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681337600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201461.878691:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788201461.878764:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681337600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201461.878771:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201461.878870:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681337600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201461.879453:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681337856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.879503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201461.879538:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681338368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.879557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201461.879569:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681338880:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.879588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201461.879607:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788201461.879612:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681337728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.879637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201461.879657:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681338240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.879698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201461.879709:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681338752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.879726:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201461.879772:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681338880 00000100:00100000:3.0:1788201461.879777:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681338880 00000100:00100000:3.0:1788201461.879818:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681338752 00000100:00100000:3.0:1788201461.879820:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681338752 00000100:00100000:3.0:1788201461.879836:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201461.879842:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681338880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.879902:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681338880:12345-0@lo:400:kworker.0 Request processed in 60us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.879908:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201461.879923:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201461.879929:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681338752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.879956:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681338752:12345-0@lo:400:kworker.0 Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.879962:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201461.879982:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681337728 00000100:00100000:3.0:1788201461.879985:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681337728 00000100:00100000:3.0:1788201461.880008:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201461.880015:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3645:x1875064681337728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201461.880325:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681337856 00000100:00100000:1.0:1788201461.880331:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681337856 00000100:00100000:0.0:1788201461.880397:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681338368 00000100:00100000:0.0:1788201461.880401:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681338368 00000100:00100000:1.0:1788201461.880427:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201461.880570:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681337856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.880644:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681339264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201461.880708:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681337856:12345-0@lo:400:kworker.0 Request processed in 273us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201461.881062:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.881122:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681337984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.881153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.881173:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681338496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.881195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.881207:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681339008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.881230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.881250:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201461.881256:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681338112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.881279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.881291:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681338624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.881311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.881322:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681339136:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.881347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.881393:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681337984 00000100:00100000:2.0:1788201461.881398:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681337984 00000100:00100000:3.0:1788201461.881873:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3645:x1875064681337728:12345-0@lo:400:kworker.0 Request processed in 1843us (2220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.881884:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201461.881959:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681337728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.881980:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681338752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882002:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681337856:0@lo:400:kworker.0 00010000:00080000:3.0:1788201461.882019:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e1c4700 x1875064681338880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201461.882030:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681338880:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882215:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681339008 00000100:00100000:3.0:1788201461.882221:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681339008 00000100:00100000:3.0:1788201461.882251:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681338112 00000100:00100000:3.0:1788201461.882255:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681338112 00000100:00100000:3.0:1788201461.882267:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681338624 00000100:00100000:3.0:1788201461.882270:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681338624 00000100:00100000:3.0:1788201461.882280:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681339136 00000100:00100000:3.0:1788201461.882282:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681339136 00000100:00100000:3.0:1788201461.882297:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201461.882306:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681339008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882535:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681339008:12345-0@lo:400:kworker.0 Request processed in 229us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.882543:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201461.882557:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201461.882572:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681338112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882603:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681338112:12345-0@lo:400:kworker.0 Request processed in 40us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.882609:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201461.882619:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201461.882625:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681338624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882650:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681338624:12345-0@lo:400:kworker.0 Request processed in 25us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.882667:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201461.882678:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201461.882684:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681339136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882712:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681339136:12345-0@lo:400:kworker.0 Request processed in 29us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.882718:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201461.882771:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681338112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882785:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681338624:0@lo:400:kworker.0 00010000:00080000:3.0:1788201461.882797:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce09e1c7800 x1875064681339136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201461.882808:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681339136:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882826:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681339008:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.882892:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681338496 00000100:00100000:3.0:1788201461.882897:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681338496 00000100:00100000:0.0:1788201461.885722:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201461.885751:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201461.885770:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681338368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201461.885823:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681338240 00000100:00100000:1.0:1788201461.885850:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681338240 00000100:00100000:1.0:1788201461.885906:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201461.885913:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681338240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201461.885916:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681338368:12345-0@lo:400:kworker.0 Request processed in 180us (6358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201461.885923:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201461.885954:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681338240:12345-0@lo:400:kworker.0 Request processed in 43us (6255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201461.885959:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201461.886054:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681339264 00000100:00100000:1.0:1788201461.886058:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681339264 00000100:00100000:1.0:1788201461.886097:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201461.886104:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681339264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201461.886130:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201461.886169:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681339264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (5108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201461.886175:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788201461.886193:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201461.886199:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201461.886203:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201461.886206:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201461.886228:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681339648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201461.886271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201461.886692:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201461.886703:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681339520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201461.886720:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681339264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201461.886733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201461.886760:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201461.886767:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681339392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201461.886779:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681339520 00000100:00100000:1.0:1788201461.886783:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681339520 00000100:00100000:0.0:1788201461.886794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.886854:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201461.886874:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681337984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.886917:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681337984:12345-0@lo:400:kworker.0 Request processed in 47us (5763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201461.886924:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201461.887102:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788201461.887118:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681337984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.887147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681338240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.887161:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681338368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.887193:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681339648 00000100:00100000:2.0:1788201461.887196:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681339648 00000100:00100000:2.0:1788201461.887221:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201461.887228:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681339648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201461.887256:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788201461.887296:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681339648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201461.887302:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201461.887343:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681339648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201461.887867:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201461.887881:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681338496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.887934:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681338496:12345-0@lo:400:kworker.0 Request processed in 59us (6738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.887941:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201461.888005:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681338496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201461.888166:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681339392 00000100:00100000:1.0:1788201461.888172:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681339392 00000100:00100000:1.0:1788201461.888195:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201461.888202:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681339520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201461.888241:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201461.888280:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681339520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201461.888287:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201461.888299:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201461.888305:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681339392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201461.888314:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201461.888343:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681339392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201461.888350:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201461.888447:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681339520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201461.888668:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681339392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201462.270931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201462.271044:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662381568 00000100:00100000:3.0:1788201462.271057:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662381568 00000100:00100000:3.0:1788201462.271157:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:3.0:1788201462.271171:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+7:15008:x1875064662381568:12345-192.168.203.2@tcp:41:lfs.0 00000004:00000024:3.0:1788201462.271257:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:1.0:1788201462.271458:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201462.271575:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+7:15008:x1875064662381568:12345-192.168.203.2@tcp:41:lfs.0 Request processed in 407us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.271584:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:3.0:1788201462.289096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.289258:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662381696 00000100:00100000:1.0:1788201462.289272:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662381696 00000100:00100000:1.0:1788201462.289373:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:1.0:1788201462.289385:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+6:15008:x1875064662381696:12345-192.168.203.2@tcp:41:lfs.0 00000004:00000024:1.0:1788201462.289426:0:19574:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788201462.289533:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+6:15008:x1875064662381696:12345-192.168.203.2@tcp:41:lfs.0 Request processed in 151us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.289541:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00080000:0.0:1788201462.291464:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201462.303881:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.305536:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662381824 00000100:00100000:1.0:1788201462.305556:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662381824 00000100:00100000:1.0:1788201462.305689:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:1.0:1788201462.305703:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02286e61-118a-46f7-9134-2c74a0c116ce+6:15008:x1875064662381824:12345-192.168.203.2@tcp:13:lfs.0 00002000:00000024:1.0:1788201462.305809:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201462.305931:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02286e61-118a-46f7-9134-2c74a0c116ce+6:15008:x1875064662381824:12345-192.168.203.2@tcp:13:lfs.0 Request processed in 231us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.305940:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00080000:0.0:1788201462.306364:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201462.313069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.313882:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662381952 00000100:00100000:1.0:1788201462.313896:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662381952 00000100:00100000:1.0:1788201462.314007:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:1.0:1788201462.314020:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02286e61-118a-46f7-9134-2c74a0c116ce+6:15008:x1875064662381952:12345-192.168.203.2@tcp:13:lfs.0 00002000:00000024:1.0:1788201462.314054:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201462.314166:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02286e61-118a-46f7-9134-2c74a0c116ce+6:15008:x1875064662381952:12345-192.168.203.2@tcp:13:lfs.0 Request processed in 149us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.314175:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00080000:0.0:1788201462.314978:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201462.549228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.551891:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662382080 00000100:00100000:1.0:1788201462.551912:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662382080 00000100:00100000:1.0:1788201462.552077:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:1.0:1788201462.552091:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+10:15042:x1875064662382080:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201462.552115:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201462.552140:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254000/0xf9b71aee447218b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc46a expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.552179:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254000/0xf9b71aee447218b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc46a expref: 11 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.552192:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254000/0xf9b71aee447218b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc46a expref: 11 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.552204:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254000, rc 0) 00000100:00100000:1.0:1788201462.552311:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15042:x1875064662382080:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 223us (3098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.552320:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:0.0:1788201462.565463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201462.567052:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662382208 00000100:00100000:3.0:1788201462.567069:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662382208 00000100:00100000:3.0:1788201462.567164:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:3.0:1788201462.567176:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15042:x1875064662382208:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788201462.567415:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15042:x1875064662382208:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 236us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.567425:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:0.0:1788201462.575677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201462.577957:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662382336 00000100:00100000:3.0:1788201462.577977:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662382336 00000100:00100000:0.0:1788201462.578352:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:0.0:1788201462.578366:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15042:x1875064662382336:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788201462.578581:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15042:x1875064662382336:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 217us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.578591:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:2.0:1788201462.582654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.583143:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662382464 00000100:00100000:1.0:1788201462.583156:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662382464 00000100:00100000:1.0:1788201462.583218:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:1.0:1788201462.583229:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15047:x1875064662382464:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201462.583518:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15047:x1875064662382464:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 289us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.583528:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:1.0:1788201462.600657:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201462.607992:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662382592 00000100:00100000:3.0:1788201462.608012:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662382592 00000100:00100000:2.0:1788201462.608272:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:2.0:1788201462.608284:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15047:x1875064662382592:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201462.608552:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15047:x1875064662382592:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 269us (7909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.608561:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:0.0:1788201462.620148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.620598:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662382720 00000100:00100000:1.0:1788201462.620612:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662382720 00000100:00100000:1.0:1788201462.620680:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:1.0:1788201462.620691:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15047:x1875064662382720:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201462.620939:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15047:x1875064662382720:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 248us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.620947:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:3.0:1788201462.626282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201462.626380:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662382848 00000100:00100000:0.0:1788201462.626391:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662382848 00000100:00100000:0.0:1788201462.626448:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:0.0:1788201462.626459:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+11:15042:x1875064662382848:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201462.626481:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201462.626504:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367c200/0xf9b71aee447218b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc49b expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.626539:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367c200/0xf9b71aee447218b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc49b expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.626549:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367c200/0xf9b71aee447218b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc49b expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.626557:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367c200, rc 0) 00000100:00100000:0.0:1788201462.626639:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+12:15042:x1875064662382848:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 181us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.626669:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:0.0:1788201462.630065:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201462.630292:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662382976 00000100:00100000:2.0:1788201462.630304:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662382976 00000100:00100000:2.0:1788201462.630382:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:2.0:1788201462.630392:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+12:15042:x1875064662382976:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788201462.630426:0:17233:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788201462.630463:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201462.630469:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201462.630472:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201462.630480:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788201462.630482:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788201462.633109:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+12:15042:x1875064662382976:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 2703us (3042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.633126:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:2.0:1788201462.637345:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201462.637463:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662383104 00000100:00100000:0.0:1788201462.637475:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662383104 00000100:00100000:0.0:1788201462.637608:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:0.0:1788201462.637621:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+12:15042:x1875064662383104:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201462.637645:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201462.637668:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc4a2 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.637702:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.637727:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.637791:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d200, rc 0) 00000100:00100000:0.0:1788201462.637870:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15042:x1875064662383104:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 252us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.637878:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:3.0:1788201462.639876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.640476:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662383232 00000100:00100000:1.0:1788201462.640488:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662383232 00000100:00100000:1.0:1788201462.640544:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:1.0:1788201462.640555:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15042:x1875064662383232:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201462.640975:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15042:x1875064662383232:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 420us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.640986:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:3.0:1788201462.644285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.644443:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662383360 00000100:00100000:1.0:1788201462.644456:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662383360 00000100:00100000:1.0:1788201462.644522:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:1.0:1788201462.644534:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15042:x1875064662383360:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201462.645526:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15042:x1875064662383360:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 984us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.645539:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:3.0:1788201462.647241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201462.647506:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662383488 00000100:00100000:2.0:1788201462.647517:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662383488 00000100:00100000:2.0:1788201462.647585:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:2.0:1788201462.647603:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15052:x1875064662383488:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201462.647954:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15052:x1875064662383488:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 352us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.647962:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00010000:00010000:0.0:1788201462.648494:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201462.650673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.653076:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662383616 00000100:00100000:1.0:1788201462.653095:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662383616 00000100:00100000:1.0:1788201462.653187:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:1.0:1788201462.653200:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15052:x1875064662383616:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201462.653427:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:15052:x1875064662383616:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 228us (2858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.653436:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:3.0:1788201462.668662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201462.669201:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662383744 00000100:00100000:2.0:1788201462.669232:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662383744 00000100:00100000:2.0:1788201462.669294:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1788201462.669305:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875064662383744:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788201462.669345:0:17241:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 5c61bae8-443f-4aeb-9491-45500cbfe20c@192.168.203.2@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1788201462.669395:0:17241:0:(genops.c:1406:class_connect()) connect: client 5c61bae8-443f-4aeb-9491-45500cbfe20c, cookie 0xf9b71aee447218c6 00000004:00100000:2.0:1788201462.669429:0:17241:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788201462.669545:0:17241:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201462.669660:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2397:x1875064662383744:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 355us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.669669:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1788201462.679368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.679512:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662384000 00000100:00100000:1.0:1788201462.679526:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662384000 00000100:00100000:1.0:1788201462.679600:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:1.0:1788201462.679619:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875064662384000:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788201462.680145:0:19574:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 5c61bae8-443f-4aeb-9491-45500cbfe20c@192.168.203.2@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1788201462.680211:0:19574:0:(genops.c:1406:class_connect()) connect: client 5c61bae8-443f-4aeb-9491-45500cbfe20c, cookie 0xf9b71aee447218cd 00000004:00100000:1.0:1788201462.680247:0:19574:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788201462.680365:0:19574:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201462.680456:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2397:x1875064662384000:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 836us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.680465:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1788201462.682989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201462.683165:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201462.683427:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662384256 00000100:00100000:2.0:1788201462.683439:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662384256 00000100:00100000:2.0:1788201462.683503:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662383872 00000100:00100000:2.0:1788201462.683507:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662383872 00000100:00100000:2.0:1788201462.683526:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1788201462.683538:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+7:15042:x1875064662384256:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201462.683577:0:17242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788201462.683662:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+7:15042:x1875064662384256:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 126us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.683670:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1788201462.683688:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1788201462.683694:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:0:x1875064662383872:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201462.683712:0:17242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788201462.683736:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:0:x1875064662383872:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 43us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.683919:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00080000:0.0:1788201462.685091:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201462.686267:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201462.686525:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662384384 00000100:00100000:2.0:1788201462.686537:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662384384 00000100:00100000:2.0:1788201462.686667:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1788201462.686680:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15042:x1875064662384384:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788201462.686843:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15042:x1875064662384384:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 165us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.686861:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1788201462.692245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201462.692318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201462.692357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201462.692492:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662384768 00000100:00100000:1.0:1788201462.692504:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662384768 00000100:00100000:1.0:1788201462.692572:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1788201462.692599:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15042:x1875064662384768:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788201462.692720:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15042:x1875064662384768:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 138us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.692729:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:0.0:1788201462.693117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201462.698392:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662384512 00000100:00100000:3.0:1788201462.699165:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662384512 00000100:00100000:3.0:1788201462.699240:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662384640 00000100:00100000:3.0:1788201462.699245:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662384640 00000100:00100000:3.0:1788201462.699282:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1788201462.699306:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875064662384512:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788201462.699353:0:18748:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 5c61bae8-443f-4aeb-9491-45500cbfe20c@192.168.203.2@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1788201462.699394:0:18748:0:(genops.c:1406:class_connect()) connect: client 5c61bae8-443f-4aeb-9491-45500cbfe20c, cookie 0xf9b71aee447218d4 00002000:00100000:3.0:1788201462.699409:0:18748:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5c61bae8-443f-4aeb-9491-45500cbfe20c/ffff9cdf81980000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788201462.699539:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201462.699547:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875064662384640:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788201462.699566:0:19309:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 5c61bae8-443f-4aeb-9491-45500cbfe20c@192.168.203.2@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:0.0:1788201462.699598:0:19309:0:(genops.c:1406:class_connect()) connect: client 5c61bae8-443f-4aeb-9491-45500cbfe20c, cookie 0xf9b71aee447218db 00002000:00100000:0.0:1788201462.699605:0:19309:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5c61bae8-443f-4aeb-9491-45500cbfe20c/ffff9cdf819de800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201462.699621:0:19309:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788201462.699758:0:19309:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201462.699801:0:19309:0:(import.c:65:import_set_state_nolock()) ffff9cdf819dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201462.699900:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2397:x1875064662384640:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 352us (7542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.699909:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201462.699998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201462.700158:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662384896 00000100:00100000:0.0:1788201462.700165:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662384896 00000100:00100000:0.0:1788201462.700202:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1788201462.700209:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15042:x1875064662384896:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788201462.700302:0:17244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788201462.700363:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15042:x1875064662384896:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 155us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.700371:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00002000:00100000:3.0:1788201462.701207:0:18748:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201462.701295:0:18748:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201462.701349:0:18748:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5bee800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201462.701402:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2397:x1875064662384512:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 2097us (9084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.702568:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1788201462.702640:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662384128 00000100:00100000:3.0:1788201462.702650:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662384128 00000100:00100000:3.0:1788201462.702728:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201462.702752:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:0:x1875064662384128:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788201462.702784:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788201462.702862:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:0:x1875064662384128:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 117us (9737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.702869:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00080000:1.0:1788201462.703026:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1788201462.838541:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788201462.890504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201462.890616:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662385024 00000100:00100000:3.0:1788201462.890628:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662385024 00000100:00100000:3.0:1788201462.890718:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201462.890730:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15075:x1875064662385024:12345-192.168.203.2@tcp:101:mkdir.0 00010000:00010000:3.0:1788201462.890792:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201462.890821:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030000/0xf9b71aee447218e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc4d3 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.890937:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.890954:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.890969:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201462.891028:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201462.891032:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201462.891059:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.891088:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030000/0xf9b71aee447218e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 8 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.891109:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 7 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.891119:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc100) 00010000:00010000:3.0:1788201462.891122:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201462.891126:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce080030800, rc 0) 00000100:00100000:3.0:1788201462.891201:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+7:15075:x1875064662385024:12345-192.168.203.2@tcp:101:mkdir.0 Request processed in 474us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.891209:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00010000:00010000:1.0:1788201463.670549:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201464.694166:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201465.466089:0:17220:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5c61bae8-443f-4aeb-9491-45500cbfe20c 00000001:00100000:1.0:1788201465.466106:0:17220:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 02286e61-118a-46f7-9134-2c74a0c116ce 00000001:00100000:1.0:1788201465.466145:0:19559:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5c61bae8-443f-4aeb-9491-45500cbfe20c 00000001:00100000:1.0:1788201465.466152:0:19559:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02286e61-118a-46f7-9134-2c74a0c116ce 00000001:00100000:3.0:1788201465.471700:0:17973:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5c61bae8-443f-4aeb-9491-45500cbfe20c 00000001:00100000:3.0:1788201465.471719:0:17973:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 02286e61-118a-46f7-9134-2c74a0c116ce 00000001:00100000:2.0:1788201465.475995:0:18742:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5c61bae8-443f-4aeb-9491-45500cbfe20c 00000001:00100000:2.0:1788201465.476013:0:18742:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02286e61-118a-46f7-9134-2c74a0c116ce 00010000:00010000:0.0:1788201465.719341:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201465.948799:0:20118:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788201466.486082:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681339776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201466.486180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201466.486562:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681339776 00000100:00100000:3.0:1788201466.486573:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681339776 00000100:00100000:3.0:1788201466.486659:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201466.486672:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681339776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201466.486713:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788201466.486807:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681339776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201466.486815:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788201466.486987:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201466.487154:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681339776:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201466.741945:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201466.998061:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201466.998095:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681339904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201466.998162:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201466.998177:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681340032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201466.998206:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201466.998360:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201466.998371:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681340160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201466.998468:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681340416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201467.003614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201467.003762:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681340288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201467.003779:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681340032 00000100:00100000:2.0:1788201467.003791:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681340032 00000100:00100000:3.0:1788201467.003855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201467.003862:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201467.003874:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681340032:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201467.003903:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681339904 00000100:00100000:3.0:1788201467.003909:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681339904 00000004:00000024:2.0:1788201467.003923:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788201467.003956:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681340288 00000100:00100000:3.0:1788201467.003960:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681340288 00000100:00100000:3.0:1788201467.003985:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201467.003991:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681340032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201467.003997:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681339904:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201467.004005:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00002000:00000024:3.0:1788201467.004021:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788201467.004068:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681340032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201467.004105:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201467.004124:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681340160 00000100:00100000:2.0:1788201467.004127:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681340160 00000100:00100000:2.0:1788201467.004149:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201467.004155:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681339904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (5950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201467.004163:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201467.004176:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681340160:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201467.004186:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201467.004195:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681340288:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:2.0:1788201467.004198:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00002000:00000024:3.0:1788201467.004216:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201467.004234:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681340160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201467.004241:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201467.004261:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681340288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201467.004276:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201467.004297:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681340160:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788201467.004306:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201467.004313:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201467.004923:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681340544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.004963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201467.004989:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681340544 00000100:00100000:2.0:1788201467.004993:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681340544 00000100:00100000:2.0:1788201467.005022:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201467.005028:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681340544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.005058:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681340544:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201467.005064:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201467.005105:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681340544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.005112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681341056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.005133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201467.005160:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201467.005166:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681340672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.005186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201467.005200:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681341184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.005217:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.005548:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.005760:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681340928:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.005790:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.005817:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201467.005834:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681340800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.005858:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201467.005875:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681340672 00000100:00100000:1.0:1788201467.005884:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681340672 00000100:00100000:0.0:1788201467.005886:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681341440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.005916:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201467.005928:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681341056 00000100:00100000:3.0:1788201467.005935:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681341056 00000100:00100000:0.0:1788201467.005937:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201467.005945:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681341312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201467.005950:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681340928 00000100:00100000:1.0:1788201467.005955:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681340928 00000100:00100000:3.0:1788201467.005968:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681341184 00000100:00100000:0.0:1788201467.005972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201467.005974:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681341184 00000100:00100000:3.0:1788201467.006002:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681341440 00000100:00100000:0.0:1788201467.006002:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681340800 00000100:00100000:0.0:1788201467.006008:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681340800 00000100:00100000:3.0:1788201467.006009:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681341440 00000100:00100000:1.0:1788201467.006010:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201467.006023:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681340672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201467.006034:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681341312 00000100:00100000:3.0:1788201467.006038:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681341312 00000100:00100000:0.0:1788201467.006045:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201467.006054:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681341056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201467.006084:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681340672:12345-0@lo:400:kworker.0 Request processed in 63us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.006096:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681341056:12345-0@lo:400:kworker.0 Request processed in 44us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201467.006127:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201467.006147:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681340416 00000100:00100000:1.0:1788201467.006150:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201467.006158:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681340416 00000100:00100000:1.0:1788201467.006159:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681340928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.006191:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201467.006199:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681340416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201467.006207:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681340928:12345-0@lo:400:kworker.0 Request processed in 49us (415us total) trans 0 rc 0/0 00002000:00000024:2.0:1788201467.006214:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201467.006215:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201467.006449:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681340416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 251us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201467.006456:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201467.006476:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681341568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.006563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201467.006680:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201467.006694:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681341184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.006797:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201467.006816:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681341568 00000100:00100000:0.0:1788201467.006819:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681341568 00000100:00100000:3.0:1788201467.006858:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681341184:12345-0@lo:400:kworker.0 Request processed in 167us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.006859:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201467.006873:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201467.006873:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681341440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201467.006893:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201467.006902:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681340800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.006923:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681341440:12345-0@lo:400:kworker.0 Request processed in 51us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.006940:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201467.006945:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681340800:12345-0@lo:400:kworker.0 Request processed in 43us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201467.006951:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201467.006961:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201467.006971:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681341312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201467.006973:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201467.006986:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681341568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.007021:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681341312:12345-0@lo:400:kworker.0 Request processed in 51us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201467.007029:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681341568:12345-0@lo:400:kworker.0 Request processed in 46us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.007030:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201467.007040:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788201467.007079:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf837a4e00 x1875064681341312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201467.007084:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201467.007096:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681341312:0@lo:400:kworker.0 00000100:00080000:3.0:1788201467.007097:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201467.007104:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201467.007114:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681341440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.007128:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681340800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.007147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681340928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201467.007158:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681340288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201467.007170:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681340416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201467.007187:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681339904:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788201467.008048:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834ced80 x1875064681341568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201467.008061:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681341568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.008076:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681340672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.008087:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681341184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201467.008100:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681341056:0@lo:400:kworker.0 00010000:00010000:2.0:1788201467.766032:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201468.101373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101436:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101473:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101506:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201468.101588:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662385152 00000100:00100000:0.0:1788201468.101609:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662385152 00000100:00100000:0.0:1788201468.101658:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 147 00000100:00100000:0.0:1788201468.101668:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2401:x1875064662385152:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201468.101866:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662385280 00000100:00100000:1.0:1788201468.101871:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662385280 00000100:00100000:1.0:1788201468.101903:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662385408 00000100:00100000:1.0:1788201468.101906:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662385408 00000100:00100000:1.0:1788201468.101917:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662385792 00000100:00100000:1.0:1788201468.101920:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662385792 00000100:00100000:1.0:1788201468.101930:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662385920 00000100:00100000:1.0:1788201468.101932:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662385920 00000100:00100000:1.0:1788201468.101945:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:1.0:1788201468.101952:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:2400:x1875064662385280:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201468.101994:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:2400:x1875064662385280:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 42us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201468.102001:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:3.0:1788201468.102012:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:1.0:1788201468.102016:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:3.0:1788201468.102020:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+5:2401:x1875064662385408:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201468.102021:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2400:x1875064662385792:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201468.102043:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2400:x1875064662385792:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 22us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201468.102044:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+5:2401:x1875064662385408:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201468.102049:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:0.0:1788201468.102431:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2401:x1875064662385152:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 764us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201468.102439:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 147 00000100:00100000:0.0:1788201468.102481:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662385536 00000100:00100000:0.0:1788201468.102485:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662385536 00000100:00100000:0.0:1788201468.102510:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662385664 00000100:00100000:0.0:1788201468.102513:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662385664 00000100:00100000:0.0:1788201468.102526:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662386176 00000100:00100000:0.0:1788201468.102529:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662386176 00000100:00100000:0.0:1788201468.102540:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662386048 00000100:00100000:0.0:1788201468.102542:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662386048 00000100:00100000:0.0:1788201468.102555:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:0.0:1788201468.102561:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+5:2400:x1875064662385536:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201468.102592:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+5:2400:x1875064662385536:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 31us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201468.102598:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:0.0:1788201468.102609:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:0.0:1788201468.102615:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+5:2401:x1875064662385664:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201468.102635:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+5:2401:x1875064662385664:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 21us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201468.102641:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:0.0:1788201468.102650:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:0.0:1788201468.102655:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2401:x1875064662386176:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201468.102685:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2401:x1875064662386176:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201468.102691:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:0.0:1788201468.102701:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:0.0:1788201468.102707:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2400:x1875064662386048:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201468.102758:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2400:x1875064662386048:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201468.102764:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:3.0:1788201468.104945:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:1.0:1788201468.104961:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:1.0:1788201468.104981:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2401:x1875064662385920:12345-192.168.203.2@tcp:400:kworker.0 00000100:00080000:3.0:1788201468.104992:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201468.104998:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201468.105000:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201468.105003:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201468.105048:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2401:x1875064662385920:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 78us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201468.105055:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000040:00080000:2.0:1788201468.278925:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788201468.793283:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201469.553148:0:20266:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd38f457b0 20000000:00000080:2.0:1788201469.553170:0:20266:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce0a5be5c00 uarg=0000000000000000 20000000:01000000:2.0:1788201469.553226:0:20266:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788201469.553233:0:20266:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788201469.553238:0:20266:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788201469.554819:0:20267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788201469.555026:0:20266:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788201469.565679:0:20266:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788201469.566343:0:20266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566367:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472157e expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566375:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472158c expref: 23 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566382:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447215cb expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566389:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721665 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566399:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566427:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566435:0:20266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566486:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566499:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 12 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201469.566517:0:20266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681341696:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201469.566649:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566657:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 12 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201469.566665:0:20266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681341824:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201469.566692:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721665 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566700:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721665 expref: 23 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201469.566710:0:20266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681341952:0@lo:104: 00000100:00100000:3.0:1788201469.566775:0:20266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201469.566841:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681341952 00000100:00100000:3.0:1788201469.566851:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681341952 00000100:00100000:3.0:1788201469.566911:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201469.566922:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:20266:x1875064681341952:12345-0@lo:104: 00010000:00010000:3.0:1788201469.566937:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.566992:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201469.566998:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:20266:x1875064681341952:12345-0@lo:104: Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201469.567005:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788201469.567006:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201469.567020:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.567028:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1e00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201469.567032:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.567041:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201469.567048:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201469.567055:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201469.567103:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.567110:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201469.567132:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.567140:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1e00/0xf9b71aee44721665 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee4472166c expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.567156:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201469.567158:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201469.567160:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201469.567168:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681342080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201469.567196:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee447215cb expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201469.567198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201469.567204:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee447215cb expref: 23 pid: 17233 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201469.567219:0:20266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681342208:0@lo:104: 00000100:00100000:2.0:1788201469.567415:0:20266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201469.567444:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472158c expref: 23 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.567453:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472158c expref: 23 pid: 17235 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201469.567463:0:20266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681342336:0@lo:104: 00000100:00100000:2.0:1788201469.567486:0:20266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201469.567511:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee4472157e expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.567519:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee4472157e expref: 23 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201469.567527:0:20266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681342464:0@lo:104: 00000100:00100000:2.0:1788201469.567546:0:20266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201469.567556:0:20266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201469.567578:0:20266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681341952:0@lo:104: 00000100:00100000:3.0:1788201469.567678:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681342208 00000100:00100000:3.0:1788201469.567683:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681342208 00000100:00100000:3.0:1788201469.567702:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681342336 00000100:00100000:3.0:1788201469.567705:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681342336 00000100:00100000:3.0:1788201469.567716:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681342464 00000100:00100000:3.0:1788201469.567718:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681342464 00000100:00100000:3.0:1788201469.567769:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201469.567777:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+5:20266:x1875064681342208:12345-0@lo:104: 00010000:00010000:3.0:1788201469.567786:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.567839:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201469.567843:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+5:20266:x1875064681342208:12345-0@lo:104: Request processed in 68us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201469.567850:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201469.567864:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201469.567876:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:20266:x1875064681342336:12345-0@lo:104: 00010000:00010000:3.0:1788201469.567885:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.567920:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201469.567925:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+4:20266:x1875064681342336:12345-0@lo:104: Request processed in 51us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201469.567931:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201469.567943:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201469.567949:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:20266:x1875064681342464:12345-0@lo:104: 00010000:00010000:3.0:1788201469.567957:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.567987:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201469.567992:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+3:20266:x1875064681342464:12345-0@lo:104: Request processed in 44us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201469.567998:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788201469.568011:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201469.568016:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568023:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201469.568027:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568034:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201469.568042:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201469.568055:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201469.568079:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568086:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201469.568104:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568111:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb400/0xf9b71aee447215cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee447215d2 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568124:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201469.568127:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568133:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201469.568136:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568143:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201469.568149:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201469.568154:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201469.568167:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568173:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201469.568187:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568194:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb200/0xf9b71aee4472158c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721593 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568203:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201469.568206:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568212:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201469.568215:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568222:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201469.568228:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201469.568233:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201469.568246:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568252:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201469.568264:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.568270:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0c00/0xf9b71aee4472157e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721585 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201469.568319:0:20266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681342208:0@lo:104: 00000100:00100000:2.0:1788201469.568326:0:20266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681342336:0@lo:104: 00000100:00100000:2.0:1788201469.568333:0:20266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681342464:0@lo:104: 00000100:00100000:2.0:1788201469.568365:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681342592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201469.568395:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201469.568409:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201469.568428:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201469.568441:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681342720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201469.568465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201469.568478:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201469.568480:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201469.568486:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201469.568489:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681342848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201469.568515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201469.570822:0:20266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681341696:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201469.570841:0:20266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875064681341824:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201469.570868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1788201469.570885:0:20266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571199:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201469.571226:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681342080 00000100:00100000:1.0:1788201469.571235:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681342080 00010000:00010000:1.0:1788201469.571275:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721665 expref: 24 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201469.571310:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681342592 00000100:00100000:1.0:1788201469.571313:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681342592 00010000:00010000:1.0:1788201469.571325:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447215cb expref: 25 pid: 17233 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201469.571335:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681342720 00000100:00100000:1.0:1788201469.571337:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681342720 00010000:00010000:1.0:1788201469.571346:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472158c expref: 26 pid: 17235 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201469.571356:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681342848 00000100:00100000:1.0:1788201469.571358:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681342848 00010000:00010000:1.0:1788201469.571368:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472157e expref: 27 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201469.571377:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662386304 00000100:00100000:1.0:1788201469.571379:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662386304 00010000:00010000:1.0:1788201469.571390:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 13 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201469.571404:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201469.571511:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+27:3647:x1875064681342080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201469.571590:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201469.571604:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721665 expref: 27 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571617:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721665 expref: 27 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571637:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bac00/0xf9b71aee4472166c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721665 expref: 27 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571656:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201469.571736:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+26:3647:x1875064681342080:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (4536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201469.571774:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201469.571794:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201469.571801:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+25:3644:x1875064681342592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201469.571818:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201469.571823:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee447215cb expref: 25 pid: 17233 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571832:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee447215cb expref: 25 pid: 17233 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571842:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367d600/0xf9b71aee447215d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee447215cb expref: 25 pid: 17233 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571852:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201469.571885:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3644:x1875064681342592:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201469.571902:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201469.571915:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201469.571922:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:3644:x1875064681342720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201469.571930:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201469.571934:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472158c expref: 23 pid: 17235 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571944:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472158c expref: 23 pid: 17235 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571953:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1400/0xf9b71aee44721593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472158c expref: 23 pid: 17235 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.571961:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201469.571985:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:3644:x1875064681342720:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (3519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201469.571991:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201469.572004:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201469.572010:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:3646:x1875064681342848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201469.572018:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201469.572022:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee4472157e expref: 21 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.572031:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee4472157e expref: 21 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.572041:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721585 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee4472157e expref: 21 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.572061:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201469.572093:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:3646:x1875064681342848:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201469.572099:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201469.572113:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:1.0:1788201469.572119:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba1cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2398:x1875064662386304:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201469.572128:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201469.572132:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 13 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.572142:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 13 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201469.572148:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681342080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201469.572152:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367d200/0xf9b71aee447218bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4a2 expref: 13 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.572160:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201469.572215:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba1cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2ec582-f6a7-44d0-975e-32edaafa1016+12:2398:x1875064662386304:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201469.572222:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:3.0:1788201469.572456:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681342720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201469.572466:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681342592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201469.572493:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681342848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201469.574716:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201469.577579:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662386432 00000100:00100000:1.0:1788201469.577610:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662386432 00010000:00010000:1.0:1788201469.577675:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 12 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201469.577732:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:1.0:1788201469.577779:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2ec582-f6a7-44d0-975e-32edaafa1016+12:2400:x1875064662386432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201469.577828:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201469.577836:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 12 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577851:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 12 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577875:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721880 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc432 expref: 12 pid: 17234 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577893:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577902:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577924:0:17227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577932:0:17227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577939:0:17227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577947:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577954:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201469.577960:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.577980:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.578004:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201469.578018:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201469.578030:0:20266:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.578039:0:20266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201469.578046:0:20266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce080031800/0xf9b71aee447218f0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201469.578097:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2ec582-f6a7-44d0-975e-32edaafa1016+11:2400:x1875064662386432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 321us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201469.578105:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00010000:00010000:3.0:1788201469.814136:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201470.838143:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201471.233711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201471.234241:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662386560 00000100:00100000:1.0:1788201471.234255:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662386560 00000100:00100000:1.0:1788201471.234380:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 148 00000100:00100000:1.0:1788201471.234394:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+11:14924:x1875064662386560:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201471.234425:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201471.234452:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254800/0xf9b71aee447218f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc4da expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201471.234490:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254800/0xf9b71aee447218f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4da expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201471.234503:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254800/0xf9b71aee447218f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4da expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201471.234514:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254800, rc 0) 00000100:00100000:1.0:1788201471.234590:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+12:14924:x1875064662386560:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 199us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201471.235310:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 148 00000100:00100000:0.0:1788201471.245546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201471.245689:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662386688 00000100:00100000:2.0:1788201471.245703:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662386688 00000100:00100000:2.0:1788201471.245806:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00100000:2.0:1788201471.245819:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+12:14924:x1875064662386688:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.246035:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+12:14924:x1875064662386688:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 218us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201471.246044:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00100000:3.0:1788201471.247908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201471.248422:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662386816 00000100:00100000:0.0:1788201471.248434:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662386816 00000100:00100000:0.0:1788201471.248498:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:0.0:1788201471.248510:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bb94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+12:14924:x1875064662386816:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.248721:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bb94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+12:14924:x1875064662386816:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 212us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.248730:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:0.0:1788201471.279137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201471.279226:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662386944 00000100:00100000:3.0:1788201471.279239:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662386944 00000100:00100000:3.0:1788201471.279308:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:3.0:1788201471.279319:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+12:14924:x1875064662386944:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201471.279342:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201471.279365:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce080030000/0xf9b71aee447218fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc4e1 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.279401:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce080030000/0xf9b71aee447218fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4e1 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.279415:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce080030000/0xf9b71aee447218fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4e1 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.279446:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce080030000, rc 0) 00000100:00100000:3.0:1788201471.279520:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+13:14924:x1875064662386944:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 202us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.279529:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:0.0:1788201471.282015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201471.282693:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662387072 00000100:00100000:3.0:1788201471.282706:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662387072 00000100:00100000:3.0:1788201471.283041:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 152 00000100:00100000:3.0:1788201471.283055:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+13:14924:x1875064662387072:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201471.283592:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+13:14924:x1875064662387072:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 538us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.283602:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 152 00000100:00100000:0.0:1788201471.286995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201471.287190:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662387200 00000100:00100000:2.0:1788201471.287216:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662387200 00000100:00100000:2.0:1788201471.287689:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00100000:2.0:1788201471.287702:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:14924:x1875064662387200:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.287971:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:14924:x1875064662387200:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 272us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201471.287979:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 153 10000000:01000000:2.0:1788201471.479207:0:17237:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201471.479218:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0849b8800 from 13 10000000:01000000:2.0:1788201471.479225:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201471.479294:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.479310:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.479323:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201471.479360:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681342976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.479461:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.479518:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201471.480336:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681342976 00000100:00100000:0.0:1788201471.480347:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681342976 00000100:00100000:0.0:1788201471.480422:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201471.480432:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:17237:x1875064681342976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201471.480468:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201471.480487:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367d000/0xf9b71aee4472190c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721905 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.480520:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367d000/0xf9b71aee4472190c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721905 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.480533:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367d000/0xf9b71aee4472190c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721905 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.480542:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d000, rc 0) 00000100:00100000:0.0:1788201471.480603:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681342976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.480610:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201471.481233:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681342976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201471.481255:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.481266:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201471.481358:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.481408:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.481444:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201471.481721:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681343104 00000100:00100000:0.0:1788201471.481728:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681343104 00000100:00100000:0.0:1788201471.481787:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201471.481804:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681343104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.481949:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681343104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.481957:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788201471.482115:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.482151:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.482202:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.482232:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201471.482268:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681343232 00000100:00100000:3.0:1788201471.482274:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681343232 00000100:00100000:3.0:1788201471.482313:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788201471.482322:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681343232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201471.482428:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681343232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.482437:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201471.483322:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201471.484858:0:20346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788201471.484974:0:17237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788201471.485002:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201471.485015:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.485028:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201471.485053:0:17237:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201471.485056:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0a02eb000 from 13 10000000:01000000:3.0:1788201471.485059:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201471.485103:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.485113:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.485125:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201471.485156:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201471.485236:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201471.485290:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201471.485355:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681343360 00000100:00100000:0.0:1788201471.485364:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681343360 00000100:00100000:0.0:1788201471.485422:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788201471.485433:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:17237:x1875064681343360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201471.485450:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201471.485467:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472191a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721913 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.485501:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472191a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721913 expref: 22 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.485512:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472191a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721913 expref: 22 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.485521:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367de00, rc 0) 00000100:00100000:0.0:1788201471.485603:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:17237:x1875064681343360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.485621:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788201471.486679:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201471.486707:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.486731:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201471.486859:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.486906:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.486937:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201471.487062:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681343488 00000100:00100000:0.0:1788201471.487069:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681343488 00000100:00100000:0.0:1788201471.487113:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788201471.487123:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:17237:x1875064681343488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.487261:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:17237:x1875064681343488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.487268:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788201471.487819:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.487867:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.487925:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.488041:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201471.488508:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681343616 00000100:00100000:3.0:1788201471.488517:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681343616 00000100:00100000:3.0:1788201471.489006:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201471.489018:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:17237:x1875064681343616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201471.489187:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:17237:x1875064681343616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.489196:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788201471.489282:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201471.490053:0:20347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788201471.490134:0:17237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788201471.490157:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201471.490169:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.490181:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201471.490193:0:17237:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201471.490196:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b3251800 from 13 10000000:01000000:2.0:1788201471.490200:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201471.490239:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.490248:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.490259:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201471.490283:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.490335:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.494854:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201471.497835:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681343744 00000100:00100000:0.0:1788201471.497854:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681343744 00000100:00100000:0.0:1788201471.497931:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201471.497943:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:17237:x1875064681343744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201471.497966:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201471.498002:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf8367d800/0xf9b71aee44721928 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721921 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.498040:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf8367d800/0xf9b71aee44721928 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721921 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.498061:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf8367d800/0xf9b71aee44721928 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721921 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.498073:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d800, rc 0) 00000100:00100000:0.0:1788201471.498385:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681343744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 443us (8049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.498392:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201471.498477:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201471.498498:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.498508:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201471.498605:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.498642:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201471.498688:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201471.498704:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681343872 00000100:00100000:0.0:1788201471.498708:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681343872 00000100:00100000:0.0:1788201471.498728:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788201471.498734:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681343872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.499377:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681343872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 640us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.499387:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788201471.499428:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681343872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.499473:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681344000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201471.499634:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201471.499692:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681344000 00000100:00100000:3.0:1788201471.499699:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681344000 00000100:00100000:2.0:1788201471.499727:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0856799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201471.499830:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788201471.499840:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681344000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201471.499960:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681344000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.499976:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788201471.500270:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681344000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201471.501326:0:20349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788201471.501591:0:17237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788201471.501622:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201471.501643:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.501655:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201471.501668:0:17237:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201471.501681:0:17237:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0ba1d3800 from 13 10000000:01000000:0.0:1788201471.501685:0:17237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201471.501727:0:17237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.501764:0:17237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.501777:0:17237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201471.501813:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681344128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.501884:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.501932:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681344128 00000100:00100000:0.0:1788201471.501938:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201471.501939:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681344128 00000100:00100000:2.0:1788201471.501986:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201471.501998:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:17237:x1875064681344128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201471.502013:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201471.502030:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721936 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee4472192f expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.502055:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee4472192f expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.502066:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee4472192f expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.502076:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03af800, rc 0) 00000100:00100000:2.0:1788201471.502128:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:17237:x1875064681344128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201471.502135:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788201471.502476:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681344128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201471.502496:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.502506:0:17237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201471.502598:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681344256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.502654:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201471.502680:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201471.502906:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681344256 00000100:00100000:3.0:1788201471.502911:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681344256 00000100:00100000:3.0:1788201471.502939:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788201471.502946:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:17237:x1875064681344256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201471.503085:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:17237:x1875064681344256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.503092:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788201471.503191:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681344256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.503223:0:17237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681344384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201471.503266:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201471.503330:0:17237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0865ef000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201471.503368:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681344384 00000100:00100000:3.0:1788201471.503372:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681344384 00000100:00100000:3.0:1788201471.503438:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788201471.503446:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:17237:x1875064681344384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201471.503541:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:17237:x1875064681344384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.503552:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788201471.503635:0:17237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:17237:1875064681344384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201471.504713:0:20350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788201471.504823:0:17237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788201471.504843:0:17237:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201471.504855:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.504866:0:17237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201471.609125:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681344512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201471.609227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201471.609919:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681344512 00000100:00100000:1.0:1788201471.609930:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681344512 00000100:00100000:1.0:1788201471.610016:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201471.610028:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681344512:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788201471.610048:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788201471.610071:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201471.610146:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681344512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201471.610153:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201471.610214:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681344512:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201471.863474:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201472.056696:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788201472.117990:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788201472.118022:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681344640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201472.118124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201472.118172:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681344768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201472.118198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201472.118316:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681344640 00000100:00100000:1.0:1788201472.118319:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681344768 00000100:00100000:2.0:1788201472.118328:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681344640 00000100:00100000:1.0:1788201472.118328:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681344768 00000100:00100000:1.0:1788201472.118396:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201472.118397:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201472.118413:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681344768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201472.118414:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681344640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201472.118460:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00002000:00000024:1.0:1788201472.118460:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201472.118527:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681344640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201472.118528:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681344768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201472.118544:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201472.118545:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201472.118764:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201472.118948:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681344640:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788201472.118963:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201472.118967:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681344768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201472.119033:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681345024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201472.119094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201472.119119:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681345536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201472.119158:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681345024 00000100:00100000:1.0:1788201472.119162:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681345024 00000100:00100000:2.0:1788201472.119164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201472.119191:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201472.119199:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681345152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201472.119203:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201472.119212:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681345024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201472.119226:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201472.119296:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681345408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201472.119965:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681345280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201472.121701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201472.121783:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681346048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201472.121850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201472.121866:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681346432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201472.121894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201472.121959:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681345408 00000100:00100000:0.0:1788201472.121969:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681345408 00000100:00100000:0.0:1788201472.122043:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201472.122055:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681345408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201472.122119:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681345408:12345-0@lo:400:kworker.0 Request processed in 66us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201472.122126:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201472.122178:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681345408:0@lo:400:kworker.0 00000100:00080000:0.0:1788201472.122237:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201472.122242:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201472.122255:0:18749:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788201472.122265:0:18749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788201472.122293:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681345536 00000100:00100000:0.0:1788201472.122297:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681345536 00000100:00100000:2.0:1788201472.122328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201472.122328:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681346432 00000100:00100000:0.0:1788201472.122333:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681346432 00000100:00100000:0.0:1788201472.122367:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201472.122376:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681345536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.122380:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681345664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.122413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201472.122441:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681345920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.122465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201472.122476:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681346560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.122497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201472.122510:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201472.122517:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681346176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.122537:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201472.122559:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681345920 00000100:00100000:2.0:1788201472.122562:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681345920 00000100:00100000:2.0:1788201472.122583:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681346560 00000100:00100000:2.0:1788201472.122585:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681346560 00000100:00100000:2.0:1788201472.122599:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681346176 00000100:00100000:2.0:1788201472.122601:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681346176 00000100:00100000:2.0:1788201472.122614:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201472.122621:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681346432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.122661:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681346432:12345-0@lo:400:kworker.0 Request processed in 40us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201472.122679:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201472.122694:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201472.122700:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681345920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.122731:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681345920:12345-0@lo:400:kworker.0 Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201472.122755:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201472.122770:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201472.122778:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201472.122808:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681345536:12345-0@lo:400:kworker.0 Request processed in 432us (3643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201472.122816:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201472.122830:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201472.122837:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681346176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201472.122867:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681346176:12345-0@lo:400:kworker.0 Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201472.122881:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788201472.122903:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201472.122906:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201472.122931:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681345664 00000100:00100000:0.0:1788201472.122935:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681345664 00000100:00100000:0.0:1788201472.122957:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201472.122963:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681345664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201472.122998:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681345664:12345-0@lo:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201472.123004:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201472.123306:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681346048 00000100:00100000:0.0:1788201472.123311:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681346048 00000100:00100000:2.0:1788201472.123441:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681346560:12345-0@lo:400:kworker.0 Request processed in 663us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201472.123448:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201472.123471:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681345152 00000100:00100000:2.0:1788201472.123474:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681345152 00000100:00100000:2.0:1788201472.123504:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788201472.123511:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bba50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681345152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.123549:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bba50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681345152:12345-0@lo:400:kworker.0 Request processed in 39us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201472.123556:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788201472.123607:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681346176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.123622:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681345920:0@lo:400:kworker.0 00010000:00080000:2.0:1788201472.123636:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8198d880 x1875064681346560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201472.123648:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681346560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.123669:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681345152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.123682:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681345664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.123694:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681345536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201472.123756:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681345024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4541us (4658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201472.123765:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201472.123800:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201472.123808:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681346048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201472.123827:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201472.123862:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681346048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201472.123868:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201472.123919:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681346048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201472.123933:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681346432:0@lo:400:kworker.0 00000100:00100000:3.0:1788201472.124198:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201472.124233:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681345792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201472.124262:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201472.124281:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681346304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201472.124442:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201472.124465:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681344896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201472.124566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201472.124611:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681346304 00000100:00100000:3.0:1788201472.124617:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681346304 00000100:00100000:3.0:1788201472.124664:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201472.124671:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681346304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201472.124714:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681346304:12345-0@lo:400:kworker.0 Request processed in 44us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201472.124721:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788201472.124811:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201472.124831:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681345280 00000100:00100000:3.0:1788201472.124835:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681345280 00000100:00100000:3.0:1788201472.124853:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681344896 00000100:00100000:3.0:1788201472.124856:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681344896 00000100:00100000:3.0:1788201472.124866:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201472.124872:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681345280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201472.124907:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875064681345280:12345-0@lo:400:kworker.0 Request processed in 36us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201472.124913:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201472.124924:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201472.124930:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681344896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201472.126265:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788201472.126468:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681344896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1533us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201472.126479:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201472.126634:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681345280:0@lo:400:kworker.0 00010000:00080000:3.0:1788201472.126675:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8198f480 x1875064681346304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201472.126686:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681346304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201472.126704:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681344896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201472.126764:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681345792 00000100:00100000:1.0:1788201472.126773:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681345792 00000100:00100000:1.0:1788201472.126842:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201472.126852:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681345792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201472.126904:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681345792:12345-0@lo:400:kworker.0 Request processed in 54us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201472.126911:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201472.126912:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681345792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201472.128427:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681345024:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201472.885981:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201472.962224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201472.963229:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662387328 00000100:00100000:0.0:1788201472.963247:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662387328 00000100:00100000:0.0:1788201472.963354:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:0.0:1788201472.963366:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+6:15592:x1875064662387328:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201472.963404:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201472.963444:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee4472193d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc4e8 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.963530:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.963546:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.963560:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.963599:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.963607:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.963613:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201472.965041:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201472.965309:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721952 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965333:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965346:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201472.965398:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201472.965403:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201472.965465:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965479:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965487:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965493:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965518:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201472.965523:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965532:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965547:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc100) 00010000:00010000:0.0:1788201472.965551:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201472.965556:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965563:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee44721944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965583:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965590:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965597:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965602:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201472.965605:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965611:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965630:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ce0b2f06200) 00010000:00010000:0.0:1788201472.965633:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201472.965636:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965642:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee4472194b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965935:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee4472193d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4e8 expref: 8 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965951:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721952 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4e8 expref: 7 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201472.965961:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce0b2f06400) 00010000:00010000:0.0:1788201472.965964:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201472.965966:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367c800, rc 0) 00000100:00100000:0.0:1788201472.966221:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+7:15592:x1875064662387328:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2855us (4007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201472.966231:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:0.0:1788201472.972345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201472.972484:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662387456 00000100:00100000:1.0:1788201472.972498:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662387456 00000100:00100000:1.0:1788201472.972956:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1788201472.972970:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:02286e61-118a-46f7-9134-2c74a0c116ce+7:15592:x1875064662387456:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788201472.973085:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:02286e61-118a-46f7-9134-2c74a0c116ce+7:15592:x1875064662387456:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 Request processed in 107us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201472.973094:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1788201472.977300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201472.978034:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662387712 00000100:00100000:3.0:1788201472.978049:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662387712 00000100:00100000:2.0:1788201472.978321:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1788201472.978333:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+7:15592:x1875064662387712:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201472.978359:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201472.978388:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721959 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc4ef expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.978491:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.978508:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.978851:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.978919:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.978929:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.978935:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979094:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae600/0xf9b71aee4472196e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979102:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae600/0xf9b71aee4472196e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979109:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae600/0xf9b71aee4472196e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201472.979120:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788201472.979405:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979413:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979420:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979427:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201472.979432:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979441:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979466:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce0b2f06400) 00010000:00010000:2.0:1788201472.979469:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201472.979474:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979491:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44721960 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.979508:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.980474:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.980492:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.980499:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aea00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201472.980502:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.980510:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.980522:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ce086201400) 00010000:00010000:2.0:1788201472.980526:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201472.980530:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.980536:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee44721967 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.982008:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721959 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4ef expref: 10 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.982052:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae600/0xf9b71aee4472196e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4ef expref: 9 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.982062:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce086201500) 00010000:00010000:2.0:1788201472.982065:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201472.982068:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03ae600, rc 0) 00000100:00100000:2.0:1788201472.982168:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+9:15592:x1875064662387712:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 3829us (4874us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788201472.982179:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1788201472.987951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201472.988076:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662387840 00000100:00100000:0.0:1788201472.988089:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662387840 00000100:00100000:0.0:1788201472.988167:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1788201472.988179:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+9:15592:x1875064662387840:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788201472.988323:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+9:15592:x1875064662387840:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 145us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201472.988353:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1788201472.994403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201472.996399:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662387968 00000100:00100000:3.0:1788201472.996418:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662387968 00000100:00100000:3.0:1788201472.996664:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:3.0:1788201472.996678:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+5:15592:x1875064662387968:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788201473.001357:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788201473.003161:0:17242:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6421us 00000100:00100000:0.0:1788201473.026714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201473.027003:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662388096 00000100:00100000:3.0:1788201473.027017:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662388096 00000100:00100000:3.0:1788201473.027090:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1788201473.027103:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+9:15598:x1875064662388096:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201473.027129:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201473.027159:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030a00/0xf9b71aee4472197c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc4f6 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027244:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027261:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027296:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027316:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027323:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027330:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027386:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027393:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027400:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027407:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201473.027412:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027421:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027436:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc100) 00010000:00010000:3.0:1788201473.027439:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201473.027445:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027458:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080031000/0xf9b71aee44721983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027476:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027482:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027488:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027494:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201473.027497:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027504:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027512:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cdf81938b00) 00010000:00010000:3.0:1788201473.027515:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201473.027518:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027524:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee4472198a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027577:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030a00/0xf9b71aee4472197c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4f6 expref: 10 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027600:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc100) 00010000:00010000:3.0:1788201473.027602:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201473.027606:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030a00/0xf9b71aee4472197c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4f6 expref: 10 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.027617:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce080030a00, rc 0) 00000100:00100000:3.0:1788201473.027702:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+9:15598:x1875064662388096:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 601us (1002us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201473.027710:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1788201473.033115:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+5:15592:x1875064662387968:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 36425us (38710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201473.033132:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:0.0:1788201473.036352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.036491:0:17249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662388224 00000100:00100000:1.0:1788201473.036505:0:17249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662388224 00000100:00100000:1.0:1788201473.036589:0:17249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:1.0:1788201473.036602:0:17249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:02286e61-118a-46f7-9134-2c74a0c116ce+9:15598:x1875064662388224:12345-192.168.203.2@tcp:700:lfs.0 00000100:00100000:1.0:1788201473.036727:0:17249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:02286e61-118a-46f7-9134-2c74a0c116ce+9:15598:x1875064662388224:12345-192.168.203.2@tcp:700:lfs.0 Request processed in 128us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.036765:0:17249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:1.0:1788201473.040477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201473.040897:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662388480 00000100:00100000:2.0:1788201473.040911:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662388480 00000100:00100000:2.0:1788201473.040982:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:2.0:1788201473.040995:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+9:15598:x1875064662388480:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:2.0:1788201473.041073:0:17240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201473.041107:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee447218aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc463 expref: 9 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.041133:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc100) 00010000:00010000:2.0:1788201473.041140:0:17240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201473.041231:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.041248:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 5 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.041278:0:17240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.041321:0:17240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 5 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.041337:0:17240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 5 pid: 17240 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201473.041354:0:17240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17240:1875064681346688:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201473.041617:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201473.045075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201473.045213:0:17240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17240:1875064681346688:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201473.045244:0:17240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201473.045477:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662388608 00000100:00100000:1.0:1788201473.045486:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662388608 00010000:00010000:1.0:1788201473.045551:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 6 pid: 17240 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201473.045600:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:1.0:1788201473.045611:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2399:x1875064662388608:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201473.045630:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201473.045638:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 6 pid: 17240 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.045659:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 6 pid: 17240 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.045686:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce080030800/0xf9b71aee447218e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4d3 expref: 6 pid: 17240 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.045701:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc100) 00010000:00010000:1.0:1788201473.045707:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.045764:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.045772:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.045807:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201473.045869:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2399:x1875064662388608:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 260us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.045876:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00080000:0.0:1788201473.046342:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201473.046825:0:17240:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.046839:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.046875:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.046889:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.046899:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051185:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051208:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051222:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201473.051879:0:17240:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c069c0b reply state 0000000003784d9b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051895:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051902:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:3.0:1788201473.051905:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201473.051910:0:17240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788201473.051916:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788201473.051925:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051932:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051938:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051945:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201473.051950:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051976:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.051986:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0866cc100) 00010000:00010000:3.0:1788201473.051989:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201473.051994:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.052000:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44721991 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201473.052023:0:17240:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c069c0b reply state 0000000003784d9b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.052032:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.052038:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cdf81938b00) 00010000:00010000:3.0:1788201473.052041:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201473.052043:0:17240:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788201473.052152:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+10:15598:x1875064662388480:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 11156us (11683us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788201473.052161:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000040:00080000:0.0:1788201473.078952:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201473.151189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.151303:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662388736 00000100:00100000:0.0:1788201473.151313:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662388736 00000100:00100000:0.0:1788201473.151387:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:0.0:1788201473.151400:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+10:15606:x1875064662388736:12345-192.168.203.2@tcp:101:lctl.0 00010000:00010000:0.0:1788201473.151426:0:19574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201473.151449:0:19574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447219a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc4fd expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.151521:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447219ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.151535:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447219ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.151546:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447219ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201473.151593:0:19574:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201473.151597:0:19574:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201473.151632:0:19574:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447219ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.151658:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447219a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4fd expref: 12 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.151690:0:19574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447219ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4fd expref: 11 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.151699:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:0.0:1788201473.151702:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201473.151706:0:19574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf8367d600, rc 0) 00000100:00100000:2.0:1788201473.155039:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+11:15606:x1875064662388736:12345-192.168.203.2@tcp:101:lctl.0 Request processed in 3621us (3839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201473.155057:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1788201473.187190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201473.187466:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662388864 00000100:00100000:3.0:1788201473.187476:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662388864 00000100:00100000:3.0:1788201473.187545:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:3.0:1788201473.187556:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:15607:x1875064662388864:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201473.187577:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201473.187610:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee447219b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc504 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.187894:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee447219bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.187909:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee447219bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.187985:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee447219bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201473.188027:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201473.188032:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201473.188050:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee447219bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.188071:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee447219b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc504 expref: 7 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.188088:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee447219bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc504 expref: 6 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.188096:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:3.0:1788201473.188099:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201473.188102:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75800, rc 0) 00000100:00100000:3.0:1788201473.188467:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15607:x1875064662388864:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 911us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201473.188475:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:3.0:1788201473.201246:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.202273:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662388992 00000100:00100000:0.0:1788201473.202283:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662388992 00000100:00100000:0.0:1788201473.202406:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:0.0:1788201473.202417:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:15607:x1875064662388992:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201473.202436:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201473.202466:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447219c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc50b expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.202538:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.202551:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.202562:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204248:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204265:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204291:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204371:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee447219d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204380:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee447219d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204387:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee447219d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201473.204428:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201473.204432:0:17242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201473.204455:0:17242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee447219d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204467:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204475:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204482:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204489:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367d200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201473.204493:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204502:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204530:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:0.0:1788201473.204533:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201473.204537:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204543:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d200/0xf9b71aee447219c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204556:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204562:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204567:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204770:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201473.204775:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204791:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204800:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cdf81938b00) 00010000:00010000:0.0:1788201473.204802:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201473.204804:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204810:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447219d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204852:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c000/0xf9b71aee447219c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc50b expref: 8 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204865:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee447219d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc50b expref: 7 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.204873:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:0.0:1788201473.204875:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201473.204877:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0800, rc 0) 00000100:00100000:0.0:1788201473.204963:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+7:15607:x1875064662388992:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 2547us (4515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.204970:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:2.0:1788201473.209253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.209356:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662389120 00000100:00100000:1.0:1788201473.209365:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662389120 00000100:00080000:3.0:1788201473.209424:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201473.209481:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:1.0:1788201473.209493:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:15607:x1875064662389120:12345-192.168.203.2@tcp:900:lfs.0 00000100:00100000:1.0:1788201473.209578:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:15607:x1875064662389120:12345-192.168.203.2@tcp:900:lfs.0 Request processed in 88us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.209586:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:3.0:1788201473.215914:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201473.216065:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662389376 00000100:00100000:2.0:1788201473.216074:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662389376 00000100:00100000:2.0:1788201473.216132:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:2.0:1788201473.216142:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+7:15607:x1875064662389376:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201473.216175:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201473.216195:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee447219de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc512 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201473.216308:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788201473.216400:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee447219de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc512 expref: 9 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.216414:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:2.0:1788201473.216417:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201473.216422:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee447219de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc512 expref: 9 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.216433:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03afc00, rc 0) 00000100:00100000:2.0:1788201473.216507:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+8:15607:x1875064662389376:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 367us (603us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788201473.216521:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:3.0:1788201473.218380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201473.218419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201473.218466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201473.218493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.218589:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662389632 00000100:00100000:0.0:1788201473.218598:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662389632 00000100:00100000:0.0:1788201473.218650:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662389888 00000100:00100000:0.0:1788201473.218653:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662389888 00000100:00100000:0.0:1788201473.218677:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662389760 00000100:00100000:0.0:1788201473.218679:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662389760 00000100:00100000:0.0:1788201473.218694:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1788201473.218703:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02286e61-118a-46f7-9134-2c74a0c116ce+5:2399:x1875064662389632:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201473.218800:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02286e61-118a-46f7-9134-2c74a0c116ce+5:2399:x1875064662389632:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 98us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.218807:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1788201473.218821:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201473.218827:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2399:x1875064662389888:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201473.218852:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2399:x1875064662389888:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.218871:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201473.218882:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1788201473.218888:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02286e61-118a-46f7-9134-2c74a0c116ce+5:2399:x1875064662389760:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201473.218910:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02286e61-118a-46f7-9134-2c74a0c116ce+5:2399:x1875064662389760:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.218915:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00080000:3.0:1788201473.219269:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201473.219274:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201473.220699:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662389504 00000100:00100000:2.0:1788201473.220709:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662389504 00000100:00100000:2.0:1788201473.220797:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:2.0:1788201473.220807:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2399:x1875064662389504:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201473.220869:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2399:x1875064662389504:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 64us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201473.220877:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:3.0:1788201473.222981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201473.226060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.226201:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662390272 00000100:00100000:0.0:1788201473.226213:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662390272 00000100:00100000:0.0:1788201473.226283:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:0.0:1788201473.226294:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+8:15607:x1875064662390272:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:0.0:1788201473.226347:0:19574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201473.226374:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee447219d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc50b expref: 8 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.226393:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:0.0:1788201473.226398:0:19574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201473.226418:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.226430:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.226439:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201473.226634:0:19574:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001c4d9c9 reply state 0000000033ac3a54 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.226662:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.226668:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:0.0:1788201473.226671:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788201473.226673:0:19574:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201473.226681:0:19574:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788201473.226808:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+9:15607:x1875064662390272:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 516us (755us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788201473.226815:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:2.0:1788201473.228960:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662390016 00000100:00100000:2.0:1788201473.228973:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662390016 00000100:00100000:2.0:1788201473.229060:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00080000:3.0:1788201473.229064:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201473.229073:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2399:x1875064662390016:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201473.229155:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2399:x1875064662390016:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 85us (6187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201473.229256:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201473.231734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.231998:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662390528 00000100:00100000:1.0:1788201473.232008:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662390528 00000100:00100000:1.0:1788201473.232055:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:1.0:1788201473.232065:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+9:15607:x1875064662390528:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1788201473.232284:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+10:15607:x1875064662390528:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 219us (556us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788201473.232292:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1788201473.235947:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201473.236094:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662390784 00000100:00100000:2.0:1788201473.236104:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662390784 00000100:00100000:2.0:1788201473.236163:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:2.0:1788201473.236173:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+10:15607:x1875064662390784:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201473.236196:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201473.236215:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee447219f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc519 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236284:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236298:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236308:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236320:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236328:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236335:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201473.236433:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788201473.236498:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236523:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236529:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236536:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aee00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201473.236539:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236547:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236559:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:2.0:1788201473.236561:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201473.236566:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236859:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee447219fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236876:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236882:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236888:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236893:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201473.236902:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236908:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.236916:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cdf81938b00) 00010000:00010000:2.0:1788201473.237198:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201473.237203:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.237209:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721a01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.237245:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee447219f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc519 expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.237254:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:2.0:1788201473.237256:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201473.237260:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee447219f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc519 expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.237269:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03afc00, rc 0) 00000100:00100000:2.0:1788201473.237329:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+11:15607:x1875064662390784:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1156us (1390us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788201473.237336:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:3.0:1788201473.240269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.240362:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662390912 00000100:00100000:0.0:1788201473.240372:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662390912 00000100:00100000:0.0:1788201473.240455:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:0.0:1788201473.240465:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+11:15607:x1875064662390912:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201473.240488:0:19574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201473.240508:0:19574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721a0f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc520 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.240694:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.240704:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.240713:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201473.240732:0:19574:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201473.240735:0:19574:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201473.241099:0:19574:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.241123:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721a0f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 13 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.241140:0:19574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 12 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.241148:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:0.0:1788201473.241150:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201473.241153:0:19574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1c00, rc 0) 00000100:00100000:0.0:1788201473.241296:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+12:15607:x1875064662390912:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 832us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.241304:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:3.0:1788201473.260610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.267487:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662391040 00000100:00100000:1.0:1788201473.267519:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662391040 00000100:00100000:1.0:1788201473.267598:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:1.0:1788201473.267609:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+12:15607:x1875064662391040:12345-192.168.203.2@tcp:37:lfs.0 00000100:00100000:1.0:1788201473.276962:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+12:15607:x1875064662391040:12345-192.168.203.2@tcp:37:lfs.0 Request processed in 9344us (16349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.276976:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1788201473.292432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201473.292533:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662391296 00000100:00100000:2.0:1788201473.292542:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662391296 00000100:00100000:2.0:1788201473.292606:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1788201473.292617:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf810c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+12:15607:x1875064662391296:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201473.292891:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf810c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+13:15607:x1875064662391296:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 274us (468us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788201473.292900:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:3.0:1788201473.384527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.384808:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662391424 00000100:00100000:0.0:1788201473.384819:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662391424 00000100:00100000:0.0:1788201473.384890:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:0.0:1788201473.384902:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+11:15613:x1875064662391424:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1788201473.384934:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201473.384956:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721a1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc527 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385018:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385032:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385042:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385070:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385077:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385085:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385155:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44721a32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385164:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44721a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385172:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44721a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201473.385204:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201473.385208:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201473.385243:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44721a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385255:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385262:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385268:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385286:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201473.385290:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385298:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385311:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:0.0:1788201473.385315:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201473.385319:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385326:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385340:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385346:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385352:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385357:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201473.385360:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385366:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385386:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cdf81938b00) 00010000:00010000:0.0:1788201473.385389:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201473.385392:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385411:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385440:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721a1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc527 expref: 13 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385464:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44721a32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc527 expref: 12 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.385473:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:0.0:1788201473.385475:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788201473.385478:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1a00, rc 0) 00000100:00100000:0.0:1788201473.385547:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+12:15613:x1875064662391424:12345-192.168.203.2@tcp:101:bash.0 Request processed in 647us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.385555:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:3.0:1788201473.395372:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201473.395585:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662391552 00000100:00100000:2.0:1788201473.395594:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662391552 00000100:00100000:2.0:1788201473.395656:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1788201473.395856:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02286e61-118a-46f7-9134-2c74a0c116ce+5:15613:x1875064662391552:12345-192.168.203.2@tcp:900:bash.0 00000100:00100000:2.0:1788201473.395998:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02286e61-118a-46f7-9134-2c74a0c116ce+5:15613:x1875064662391552:12345-192.168.203.2@tcp:900:bash.0 Request processed in 333us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201473.396006:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:3.0:1788201473.399079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.399219:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662391808 00000100:00100000:0.0:1788201473.399228:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662391808 00000100:00100000:0.0:1788201473.399281:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:0.0:1788201473.399291:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+12:15613:x1875064662391808:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1788201473.399311:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201473.399331:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721a39 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc52e expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.400037:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.400055:0:17242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 12 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.400063:0:17242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.400096:0:17242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 12 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.400109:0:17242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 12 pid: 19574 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.400122:0:17242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17242:1875064681346816:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201473.400207:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bcf00 going to sleep for 11 seconds 00000040:00080000:2.0:1788201473.400286:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788201473.409458:0:17242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17242:1875064681346816:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201473.409491:0:17242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201473.409853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.410417:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662391936 00000100:00100000:0.0:1788201473.410425:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662391936 00010000:00010000:0.0:1788201473.410473:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 13 pid: 19574 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.410515:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1788201473.410538:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+13:2399:x1875064662391936:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201473.410553:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201473.410560:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 13 pid: 19574 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.410584:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 13 pid: 19574 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.410606:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc520 expref: 13 pid: 19574 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.410622:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:0.0:1788201473.410627:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.410638:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.410647:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.410677:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201473.410772:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+12:2399:x1875064662391936:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 202us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.410790:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00010000:00010000:3.0:1788201473.411065:0:17242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411074:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411096:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411105:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411119:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411585:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411594:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411601:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201473.411611:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788201473.411637:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411643:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411648:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411654:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201473.411657:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411665:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411673:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:3.0:1788201473.411676:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201473.411685:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411691:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721a40 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201473.411704:0:17242:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d687375b reply state 00000000e7371e78 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411715:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411721:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cdf81938600) 00010000:00010000:3.0:1788201473.411723:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201473.411725:0:17242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201473.411808:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721a39 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 15 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411822:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 14 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.411829:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:3.0:1788201473.411832:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788201473.411834:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74600, rc 0) 00000100:00100000:3.0:1788201473.411871:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+15:15613:x1875064662391808:12345-192.168.203.2@tcp:101:bash.0 Request processed in 12582us (12800us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788201473.411878:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:3.0:1788201473.429260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.429593:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662392064 00000100:00100000:0.0:1788201473.429602:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662392064 00000100:00100000:0.0:1788201473.429661:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:0.0:1788201473.429671:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+15:15613:x1875064662392064:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1788201473.429707:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201473.429728:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a5c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc535 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.429826:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.429839:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.429861:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201473.429913:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788201473.429927:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201473.429946:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.429956:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.429980:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721a5c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 17 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.429998:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 16 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.430006:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:0.0:1788201473.430008:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201473.430011:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0200, rc 0) 00000100:00100000:0.0:1788201473.430076:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+16:15613:x1875064662392064:12345-192.168.203.2@tcp:101:bash.0 Request processed in 406us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.430082:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:2.0:1788201473.432896:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.433120:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662392320 00000100:00100000:0.0:1788201473.433130:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662392320 00000100:00100000:0.0:1788201473.433176:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1788201473.433187:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02286e61-118a-46f7-9134-2c74a0c116ce+16:15613:x1875064662392320:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:0.0:1788201473.433670:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02286e61-118a-46f7-9134-2c74a0c116ce+17:15613:x1875064662392320:12345-192.168.203.2@tcp:35:bash.0 Request processed in 484us (781us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788201473.433679:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:3.0:1788201473.534124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.534248:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662392576 00000100:00100000:1.0:1788201473.534261:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662392576 00000100:00100000:1.0:1788201473.534334:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:1.0:1788201473.534345:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+17:15623:x1875064662392576:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201473.534380:0:19574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201473.534409:0:19574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc53c expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201473.534557:0:19574:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788201473.534719:0:19574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc53c expref: 19 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.534937:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:1.0:1788201473.534941:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201473.534948:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc53c expref: 19 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.534965:0:19574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254a00, rc 0) 00000100:00100000:1.0:1788201473.535042:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+18:15623:x1875064662392576:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 699us (932us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788201473.535051:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:3.0:1788201473.540195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.540293:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662392832 00000100:00100000:1.0:1788201473.540306:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662392832 00000100:00100000:1.0:1788201473.540371:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:1.0:1788201473.540385:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+18:15623:x1875064662392832:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1788201473.541078:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+19:15623:x1875064662392832:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 692us (893us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788201473.541088:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1788201473.577565:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.577685:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662393088 00000100:00100000:0.0:1788201473.577699:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662393088 00000100:00100000:2.0:1788201473.578006:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:2.0:1788201473.578020:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+19:15626:x1875064662393088:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201473.578052:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201473.578076:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721a78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc543 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.578216:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af400/0xf9b71aee44721a7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.578239:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af400/0xf9b71aee44721a7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.578254:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af400/0xf9b71aee44721a7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201473.578289:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788201473.578495:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721a78 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc543 expref: 22 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.578516:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af400/0xf9b71aee44721a7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc543 expref: 21 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.578526:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:2.0:1788201473.578529:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201473.578534:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03af400, rc 0) 00000100:00100000:2.0:1788201473.578718:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+21:15626:x1875064662393088:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 700us (1166us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788201473.578727:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:3.0:1788201473.593196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201473.593300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.595013:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662393216 00000100:00100000:1.0:1788201473.595034:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662393216 00000100:00100000:1.0:1788201473.595137:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:1.0:1788201473.595150:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+21:15626:x1875064662393216:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:1.0:1788201473.595244:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595266:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595278:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595333:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595341:0:19574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595348:0:19574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595355:0:19574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254a00 already unused, calling callback (ffffffffc1b2a4f0) 00000100:00100000:2.0:1788201473.595428:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662393344 00000100:00100000:2.0:1788201473.595434:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662393344 00000100:00100000:2.0:1788201473.595482:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1788201473.595490:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02286e61-118a-46f7-9134-2c74a0c116ce+22:2401:x1875064662393344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201473.595503:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201473.595525:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af400/0xf9b71aee44721a7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc543 expref: 22 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.595546:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:2.0:1788201473.595552:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201473.595638:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02286e61-118a-46f7-9134-2c74a0c116ce+21:2401:x1875064662393344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 149us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201473.595646:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00010000:00010000:1.0:1788201473.595810:0:19574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595820:0:19574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595830:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:1.0:1788201473.595833:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201473.595836:0:19574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.595843:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201473.595883:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+20:15626:x1875064662393216:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 736us (2702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.595890:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:3.0:1788201473.598476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.598728:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662393600 00000100:00100000:1.0:1788201473.598783:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662393600 00000100:00100000:1.0:1788201473.598847:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1788201473.598860:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+20:15626:x1875064662393600:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1788201473.599445:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+21:15626:x1875064662393600:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 584us (980us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788201473.599454:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:3.0:1788201473.860184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.860307:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662393856 00000100:00100000:1.0:1788201473.860319:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662393856 00000100:00100000:1.0:1788201473.860404:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:1.0:1788201473.860422:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+21:15657:x1875064662393856:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1788201473.860458:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201473.860502:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc54a expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.860652:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721a9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.860668:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721a9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.860683:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721a9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201473.860697:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788201473.860984:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721a94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc54a expref: 24 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.861007:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721a9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc54a expref: 23 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.861017:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:1.0:1788201473.861021:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201473.861025:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254c00, rc 0) 00000100:00100000:1.0:1788201473.861102:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+23:15657:x1875064662393856:12345-192.168.203.2@tcp:101:cat.0 Request processed in 682us (930us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788201473.861109:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:3.0:1788201473.868471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.868597:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662394112 00000100:00100000:0.0:1788201473.868610:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662394112 00000100:00100000:0.0:1788201473.868685:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:0.0:1788201473.868696:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02286e61-118a-46f7-9134-2c74a0c116ce+23:15657:x1875064662394112:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1788201473.869119:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02286e61-118a-46f7-9134-2c74a0c116ce+24:15657:x1875064662394112:12345-192.168.203.2@tcp:35:cat.0 Request processed in 423us (661us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788201473.869129:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1788201473.873303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.873385:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662394240 00000100:00100000:1.0:1788201473.873399:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662394240 00000100:00100000:1.0:1788201473.873486:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:1.0:1788201473.873500:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02286e61-118a-46f7-9134-2c74a0c116ce+24:2398:x1875064662394240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201473.873541:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201473.873574:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721a9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc54a expref: 24 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.873598:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:1.0:1788201473.873603:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201473.873679:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02286e61-118a-46f7-9134-2c74a0c116ce+23:2398:x1875064662394240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 183us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.873688:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00010000:00010000:0.0:1788201473.910050:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201473.942967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.943349:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662394496 00000100:00100000:0.0:1788201473.943362:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662394496 00000100:00100000:0.0:1788201473.943449:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:0.0:1788201473.943461:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+23:15663:x1875064662394496:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:0.0:1788201473.943493:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201473.943518:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721aa9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc551 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.944129:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.944150:0:17242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.944158:0:17242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 24 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.944167:0:17242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.944212:0:17242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 24 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.944859:0:17242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 24 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.944878:0:17242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17242:1875064681346944:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201473.945056:0:17242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.945067:0:17242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 24 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.945078:0:17242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17242:1875064681347072:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201473.945119:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201473.948144:0:17242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17242:1875064681346944:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201473.948163:0:17242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17242:1875064681347072:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201473.948199:0:17242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201473.954025:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.955589:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662394624 00000100:00100000:0.0:1788201473.955606:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662394624 00010000:00010000:0.0:1788201473.955849:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 25 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.955902:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1788201473.955915:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02286e61-118a-46f7-9134-2c74a0c116ce+25:2399:x1875064662394624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201473.955934:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201473.955942:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 25 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.955957:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 25 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.955986:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721a63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc535 expref: 25 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.956007:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:0.0:1788201473.956012:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.956048:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.956056:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201473.956216:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02286e61-118a-46f7-9134-2c74a0c116ce+24:2399:x1875064662394624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 302us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.956225:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1788201473.961081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201473.961184:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662394752 00000100:00100000:2.0:1788201473.961197:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662394752 00010000:00010000:2.0:1788201473.961249:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 24 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201473.961307:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1788201473.961319:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba261450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02286e61-118a-46f7-9134-2c74a0c116ce+24:2399:x1875064662394752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201473.961338:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201473.961346:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 24 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.961362:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 24 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.961390:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44721a4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc52e expref: 24 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.961409:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:2.0:1788201473.961414:0:17227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.961425:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.961435:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.961477:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201473.961548:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba261450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02286e61-118a-46f7-9134-2c74a0c116ce+23:2399:x1875064662394752:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 230us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201473.961585:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00010000:00010000:3.0:1788201473.962786:0:17242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.962802:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201473.962831:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788201473.963038:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721aa9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc551 expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.963061:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc551 expref: 23 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.963070:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:3.0:1788201473.963073:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201473.963077:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0800, rc 0) 00000100:00100000:3.0:1788201473.963149:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+23:15663:x1875064662394496:12345-192.168.203.2@tcp:101:dd.0 Request processed in 19689us (20196us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788201473.963159:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1788201473.965307:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.965851:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662394880 00000100:00100000:1.0:1788201473.965864:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662394880 00000100:00100000:1.0:1788201473.965922:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:1.0:1788201473.965931:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+23:15663:x1875064662394880:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:1.0:1788201473.966348:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201473.966432:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721abe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc558 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.966590:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.966607:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.966867:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.967023:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721abe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 25 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.967059:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 24 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.967068:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:1.0:1788201473.967072:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201473.967076:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254a00, rc 0) 00000100:00100000:1.0:1788201473.967152:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+24:15663:x1875064662394880:12345-192.168.203.2@tcp:101:dd.0 Request processed in 1222us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.967161:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1788201473.974596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.974686:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662395136 00000100:00100000:1.0:1788201473.974699:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662395136 00000100:00100000:1.0:1788201473.974820:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:1.0:1788201473.974833:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+24:15663:x1875064662395136:12345-192.168.203.2@tcp:36:dd.0 00010000:00010000:1.0:1788201473.975150:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.975172:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.975186:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201473.975279:0:19574:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788201473.975309:0:19574:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015cf910d reply state 00000000d8d01910 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.975325:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.975352:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:1.0:1788201473.975355:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201473.975360:0:19574:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201473.976151:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+27:15663:x1875064662395136:12345-192.168.203.2@tcp:36:dd.0 Request processed in 1314us (1560us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788201473.976162:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000020:00080000:1.0:1788201473.976169:0:19574:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788201473.978985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201473.979287:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662395264 00000100:00100000:3.0:1788201473.979300:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662395264 00000100:00100000:3.0:1788201473.979376:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:3.0:1788201473.979388:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+27:15663:x1875064662395264:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:3.0:1788201473.979422:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201473.979452:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee44721ad3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc55f expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.980132:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee44721ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc55f expref: 28 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.980155:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee44721ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc55f expref: 28 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.980183:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:2.0:1788201473.980187:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201473.980191:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74200, rc 0) 00000100:00100000:2.0:1788201473.980315:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+28:15663:x1875064662395264:12345-192.168.203.2@tcp:101:dd.0 Request processed in 929us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201473.980324:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:3.0:1788201473.988678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.988769:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662395520 00000100:00100000:1.0:1788201473.988792:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662395520 00000100:00100000:1.0:1788201473.988915:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:1.0:1788201473.988926:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02286e61-118a-46f7-9134-2c74a0c116ce+28:15663:x1875064662395520:12345-192.168.203.2@tcp:103:dd.0 00010000:00010000:1.0:1788201473.988943:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201473.988971:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee44721ad3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc55f expref: 28 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.988991:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:1.0:1788201473.989004:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201473.989066:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02286e61-118a-46f7-9134-2c74a0c116ce+27:15663:x1875064662395520:12345-192.168.203.2@tcp:103:dd.0 Request processed in 143us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.989071:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1788201473.990758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201473.990946:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662395648 00000100:00100000:0.0:1788201473.990955:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662395648 00000100:00100000:0.0:1788201473.991009:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:0.0:1788201473.991020:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+27:15663:x1875064662395648:12345-192.168.203.2@tcp:58:dd.0 00010000:00010000:0.0:1788201473.991149:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.991169:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.991183:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201473.992303:0:17242:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201473.992762:0:17242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788201473.992955:0:17242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788201473.993086:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+27:15663:x1875064662395648:12345-192.168.203.2@tcp:58:dd.0 Request processed in 2060us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.993098:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:3.0:1788201473.997451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201473.997981:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662395776 00000100:00100000:1.0:1788201473.997995:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662395776 00000100:00100000:1.0:1788201473.998124:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:1.0:1788201473.998137:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+27:15663:x1875064662395776:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:1.0:1788201473.998164:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201473.998192:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc566 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.998290:0:17241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.998319:0:17241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.998343:0:17241:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.998359:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.998375:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:1.0:1788201473.998379:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201473.998383:0:17241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.998392:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255600, rc 0) 00000100:00100000:1.0:1788201473.998472:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+28:15663:x1875064662395776:12345-192.168.203.2@tcp:101:dd.0 Request processed in 337us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.998481:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000040:00080000:2.0:1788201474.422159:0:17275:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788201474.422172:0:17275:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201474.422208:0:17275:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788201474.422218:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788201474.422393:0:17275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17275:1875064681347200:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201474.422520:0:17275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08507f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201474.431185:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201474.431333:0:17275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17275:1875064681347200:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788201474.431524:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662395904 00000100:00100000:1.0:1788201474.431533:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662395904 00000100:00100000:1.0:1788201474.431627:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:1.0:1788201474.431640:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+28:15664:x1875064662395904:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788201474.431681:0:19574:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788201474.432241:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+28:15664:x1875064662395904:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 601us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201474.432250:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00080000:3.0:1788201474.432974:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201474.437368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201474.437704:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662396032 00000100:00100000:2.0:1788201474.437718:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662396032 00000100:00100000:2.0:1788201474.437840:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:2.0:1788201474.437853:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+28:15664:x1875064662396032:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788201474.438108:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438130:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438145:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438163:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438171:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438177:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438205:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438229:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438237:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201474.438297:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788201474.438303:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201474.438318:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438331:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438347:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438356:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438363:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201474.438369:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438379:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438395:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce086201500) 00010000:00010000:2.0:1788201474.438398:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201474.438403:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438410:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721ae8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438426:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438433:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438440:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438445:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afa00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201474.438455:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438462:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438471:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ce086201400) 00010000:00010000:2.0:1788201474.438474:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201474.438477:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438483:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721aef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438500:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438507:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438513:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438519:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aee00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201474.438523:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438529:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438537:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:2.0:1788201474.438540:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201474.438549:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.438555:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44721af6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201474.439189:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+28:15664:x1875064662396032:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 1330us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201474.439202:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:2.0:1788201474.447524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.447651:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662396288 00000100:00100000:3.0:1788201474.447664:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662396288 00000100:00100000:3.0:1788201474.447765:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:3.0:1788201474.447788:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+28:15664:x1875064662396288:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201474.447817:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201474.447844:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75e00/0xf9b71aee44721afd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc56d expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.447990:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448010:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448023:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201474.448057:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788201474.448157:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448166:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448173:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448180:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201474.448184:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448192:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448207:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:3.0:1788201474.448210:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201474.448215:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448221:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44721b04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448270:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75e00/0xf9b71aee44721afd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc56d expref: 30 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448281:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce086201500) 00010000:00010000:3.0:1788201474.448284:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201474.448294:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75e00/0xf9b71aee44721afd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc56d expref: 30 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.448304:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75e00, rc 0) 00000100:00100000:3.0:1788201474.448380:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+29:15664:x1875064662396288:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 595us (869us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788201474.448387:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:3.0:1788201474.451497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201474.451584:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662396416 00000100:00100000:1.0:1788201474.451596:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662396416 00000100:00100000:1.0:1788201474.451670:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:1.0:1788201474.451682:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+29:15664:x1875064662396416:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788201474.451729:0:17241:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788201474.454722:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+29:15664:x1875064662396416:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 3024us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201474.454752:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:3.0:1788201474.463314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201474.463622:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662396672 00000100:00100000:1.0:1788201474.463636:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662396672 00000100:00100000:1.0:1788201474.463718:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:1.0:1788201474.463731:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+29:15664:x1875064662396672:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201474.463816:0:19574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201474.463844:0:19574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b12 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc574 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201474.464351:0:19574:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1788201474.464359:0:19574:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788201474.464384:0:19574:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788201474.464576:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254400/0xf9b71aee44721b19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.464595:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254400/0xf9b71aee44721b19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.464631:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254400/0xf9b71aee44721b19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.464708:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b12 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc574 expref: 32 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.464730:0:19574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254400/0xf9b71aee44721b19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc574 expref: 31 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.464801:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0866ccd00) 00010000:00010000:1.0:1788201474.464804:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201474.464809:0:19574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254400, rc 0) 00000100:00100000:1.0:1788201474.464892:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+31:15664:x1875064662396672:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1163us (1592us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788201474.464901:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:0.0:1788201474.468879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201474.469350:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662396928 00000100:00100000:2.0:1788201474.469363:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662396928 00000100:00100000:2.0:1788201474.469479:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:2.0:1788201474.469503:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+31:15664:x1875064662396928:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201474.469584:0:17240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201474.469618:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254400/0xf9b71aee44721b19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc574 expref: 31 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469653:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0866ccd00) 00010000:00010000:2.0:1788201474.469666:0:17240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201474.469704:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469721:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469733:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469827:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469852:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469859:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469922:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469930:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469937:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469944:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afa00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201474.469949:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469958:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469967:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:2.0:1788201474.469970:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201474.469974:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469981:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afa00/0xf9b71aee44721b27 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.469991:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.470004:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.470011:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.470016:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201474.470020:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.470026:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.470035:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x55f7da9f (ffff9ce086201400) 00010000:00010000:2.0:1788201474.470037:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201474.470040:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.470046:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af600/0xf9b71aee44721b2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x55f7da9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201474.470159:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+30:15664:x1875064662396928:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 669us (1293us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201474.470167:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:2.0:1788201474.474985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201474.475228:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662397056 00000100:00100000:0.0:1788201474.475258:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662397056 00000100:00100000:0.0:1788201474.475337:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1788201474.475350:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+30:15664:x1875064662397056:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201474.475377:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201474.475407:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b35 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc57b expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.475455:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee44721b3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.475471:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee44721b3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.475484:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee44721b3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.475625:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc57b expref: 32 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.475649:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee44721b3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc57b expref: 31 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.475658:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:0.0:1788201474.475661:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201474.475666:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1400, rc 0) 00000100:00100000:0.0:1788201474.475797:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+31:15664:x1875064662397056:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 449us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201474.475804:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:3.0:1788201474.477968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201474.478038:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662397312 00000100:00100000:1.0:1788201474.478052:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662397312 00000100:00100000:1.0:1788201474.478261:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:1.0:1788201474.478274:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+31:15664:x1875064662397312:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201474.478395:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.478418:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.478432:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201474.479605:0:17241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788201474.480258:0:17241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554777518342ns, next at 555776879936ns, rc = 0 00000004:00010000:1.0:1788201474.480364:0:17241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ef912dc reply state 00000000a323fd1f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.480387:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.480397:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:1.0:1788201474.480401:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788201474.480406:0:17241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201474.480567:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+33:15664:x1875064662397312:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 2290us (2605us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788201474.480577:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:2.0:1788201474.488806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201474.489007:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662397440 00000100:00100000:0.0:1788201474.489038:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662397440 00000100:00100000:0.0:1788201474.489111:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:0.0:1788201474.489123:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+33:15664:x1875064662397440:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201474.489156:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201474.489181:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc582 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.489258:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 34 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.489276:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 34 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.489299:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:0.0:1788201474.489304:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201474.489309:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0e00, rc 0) 00000100:00100000:0.0:1788201474.489386:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+34:15664:x1875064662397440:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 264us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201474.489393:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1788201474.492256:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201474.492344:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662397568 00000100:00100000:1.0:1788201474.492355:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662397568 00000100:00100000:1.0:1788201474.492424:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:1.0:1788201474.492436:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02286e61-118a-46f7-9134-2c74a0c116ce+5:2399:x1875064662397568:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788201474.500267:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02286e61-118a-46f7-9134-2c74a0c116ce+6:2399:x1875064662397568:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 7815us (8007us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788201474.500287:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:3.0:1788201474.509397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201474.509678:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662397824 00000100:00100000:0.0:1788201474.509691:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662397824 00000100:00100000:0.0:1788201474.509815:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:0.0:1788201474.509828:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02286e61-118a-46f7-9134-2c74a0c116ce+34:15664:x1875064662397824:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788201474.509836:0:17243:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788201474.509857:0:17243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788201474.510374:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02286e61-118a-46f7-9134-2c74a0c116ce+35:15664:x1875064662397824:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 547us (989us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788201474.510386:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1788201474.514996:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201474.515240:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662398080 00000100:00100000:0.0:1788201474.515265:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662398080 00000100:00100000:0.0:1788201474.515345:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:0.0:1788201474.515356:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+35:15664:x1875064662398080:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788201474.515487:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+35:15664:x1875064662398080:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 132us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201474.515496:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:1.0:1788201474.520917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201474.522061:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662398208 00000100:00100000:0.0:1788201474.522084:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662398208 00000100:00100000:0.0:1788201474.522156:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1788201474.522169:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+35:15664:x1875064662398208:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201474.522197:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201474.522225:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721b51 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc589 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.522318:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721b58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.522334:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.522348:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201474.522403:0:17242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201474.522537:0:17242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.522570:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee44721b51 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc589 expref: 37 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.522621:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721b58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc589 expref: 36 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.522631:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:0.0:1788201474.522634:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788201474.522639:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1c00, rc 0) 00000100:00100000:0.0:1788201474.522959:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+36:15664:x1875064662398208:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 791us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201474.522968:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:1.0:1788201474.527994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.528188:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662398336 00000100:00100000:3.0:1788201474.528201:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662398336 00000100:00100000:3.0:1788201474.528266:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201474.528278:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:2398:x1875064662398336:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201474.528302:0:18746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201474.528327:0:18746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc590 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201474.528358:0:18746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95ca01, blocks: 0x0 00010000:00010000:3.0:1788201474.528381:0:18746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=554s v=(0 0) 00010000:00010000:3.0:1788201474.528386:0:18746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201474.528396:0:18746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 7 pid: 18746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.528418:0:18746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 7 pid: 18746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.528450:0:18746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75e00, rc 0) 00000100:00100000:3.0:1788201474.528572:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+7:2398:x1875064662398336:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 289us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201474.528580:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:1.0:1788201474.537016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201474.537097:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662398592 00000100:00100000:2.0:1788201474.537110:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662398592 00000100:00100000:2.0:1788201474.537398:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:2.0:1788201474.537410:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+36:15664:x1875064662398592:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788201474.537562:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+36:15664:x1875064662398592:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 154us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201474.537571:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1788201474.552083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201474.552185:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662398720 00000100:00100000:1.0:1788201474.552283:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662398720 00000100:00100000:0.0:1788201474.552493:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:0.0:1788201474.552507:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+36:15664:x1875064662398720:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788201474.556075:0:17220:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788201474.556099:0:17220:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788201474.556249:0:17220:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788201474.556533:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681347328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788201474.556686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201474.556837:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.556852:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.556862:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.556869:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201474.556874:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.556882:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.556902:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:3.0:1788201474.556906:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788201474.556913:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.556920:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee447219ec lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.556981:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.556991:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.556997:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557003:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201474.557006:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557013:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557030:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cdf81938b00) 00010000:00010000:0.0:1788201474.557033:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201474.557036:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557043:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74c00/0xf9b71aee44721998 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557064:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557071:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557077:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557082:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201474.557085:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557091:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557099:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:0.0:1788201474.557101:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201474.557104:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557110:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee4472199f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557350:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557358:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557363:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557368:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201474.557371:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557376:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557385:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cdf81938600) 00010000:00010000:0.0:1788201474.557387:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201474.557390:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557395:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44721a47 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557412:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557418:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557423:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557443:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201474.557447:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557453:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557462:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:0.0:1788201474.557464:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201474.557467:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557474:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44721acc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557487:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557493:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557498:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557503:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201474.557505:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557511:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557528:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:0.0:1788201474.557530:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201474.557534:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.557539:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254200/0xf9b71aee44721b43 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201474.557938:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+15:15664:x1875064662398720:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 5429us (5863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201474.557950:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:3.0:1788201474.558831:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681347328 00000100:00100000:3.0:1788201474.558863:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681347328 00000100:00100000:3.0:1788201474.558944:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201474.558957:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681347328:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788201474.559059:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788201474.559681:0:19309:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201474.559686:0:19309:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788201474.559689:0:19309:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788201474.559692:0:19309:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788201473 -> 1788201473 00002000:00010000:3.0:1788201474.559695:0:19309:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788201474.573689:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681347328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 14719us (16985us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788201474.573709:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201474.573822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.573875:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662398848 00000100:00100000:3.0:1788201474.573886:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662398848 00000100:00100000:3.0:1788201474.573950:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1788201474.573961:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce084b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02286e61-118a-46f7-9134-2c74a0c116ce+7:2399:x1875064662398848:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788201474.574051:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ce09e1c4a80/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788201474.574059:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681347328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788201474.574166:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce084b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02286e61-118a-46f7-9134-2c74a0c116ce+7:2399:x1875064662398848:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 207us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201474.574174:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:1.0:1788201474.579032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201474.579646:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662399104 00000100:00100000:2.0:1788201474.579660:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662399104 00000100:00100000:2.0:1788201474.579845:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:2.0:1788201474.579859:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+15:15664:x1875064662399104:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201474.579936:0:17240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201474.579971:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44721b58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc589 expref: 15 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.579997:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:2.0:1788201474.580003:0:17240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201474.580053:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.580071:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.580111:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201474.580272:0:17240:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026a6833d reply state 0000000054b0b283 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.580287:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.580301:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:2.0:1788201474.580304:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201474.580307:0:17240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201474.580451:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02286e61-118a-46f7-9134-2c74a0c116ce+16:15664:x1875064662399104:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 595us (1433us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788201474.580459:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:1.0:1788201474.583238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201474.583314:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662399232 00000100:00100000:0.0:1788201474.583327:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662399232 00000100:00100000:0.0:1788201474.583413:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1788201474.583421:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02286e61-118a-46f7-9134-2c74a0c116ce+7:15664:x1875064662399232:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201474.583511:0:18747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201474.583537:0:18747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc597 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.583578:0:18747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 8 pid: 18746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.583587:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201474.583592:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201474.583598:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 8 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.583661:0:18747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 8 pid: 18746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.583677:0:18747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 8 pid: 18746 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201474.583694:0:18747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18747:1875064681347456:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201474.583936:0:18747:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf823bc780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201474.593632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201474.593691:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662399360 00000100:00100000:2.0:1788201474.593703:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662399360 00010000:00010000:2.0:1788201474.593796:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 9 pid: 18746 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201474.593845:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1788201474.593858:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02286e61-118a-46f7-9134-2c74a0c116ce+9:2398:x1875064662399360:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201474.593878:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201474.593907:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 9 pid: 18746 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.593923:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 9 pid: 18746 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.593974:0:17226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201474.593980:0:17226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201474.593989:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 9 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.594001:0:17226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 9 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.594043:0:17226:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 9 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.594048:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000199d5868/0xf9b71aee44721b5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc590 expref: 9 pid: 18746 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201474.594060:0:17226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17226:1875064681347584:192.168.203.2@tcp:105: 00000100:00100000:1.0:1788201474.594064:0:18747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18747:1875064681347456:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201474.594094:0:18747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 8 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.594105:0:18747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0400, rc 0) 00000100:00100000:1.0:1788201474.594132:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02286e61-118a-46f7-9134-2c74a0c116ce+8:15664:x1875064662399232:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 10712us (10909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201474.594140:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1788201474.594156:0:17226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08507fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201474.599961:0:17226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17226:1875064681347584:192.168.203.2@tcp:105: 00010000:00010000:2.0:1788201474.599999:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201474.600081:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02286e61-118a-46f7-9134-2c74a0c116ce+7:2398:x1875064662399360:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6225us (6463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201474.600095:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:1.0:1788201474.600733:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.600997:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662399488 00000100:00100000:3.0:1788201474.601008:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662399488 00000100:00100000:3.0:1788201474.601118:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:3.0:1788201474.601130:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02286e61-118a-46f7-9134-2c74a0c116ce+7:2398:x1875064662399488:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788201474.601334:0:19309:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201474.601338:0:19309:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788201473 00002000:00010000:3.0:1788201474.601341:0:19309:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788201472 00002000:00010000:3.0:1788201474.601343:0:19309:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788201473 -> 1788201473 00002000:00010000:3.0:1788201474.601363:0:19309:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788201474.601410:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02286e61-118a-46f7-9134-2c74a0c116ce+8:2398:x1875064662399488:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 283us (680us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788201474.601417:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1788201474.605989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.606114:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662399616 00000100:00100000:3.0:1788201474.606126:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662399616 00000100:00100000:3.0:1788201474.606210:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:3.0:1788201474.606223:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+8:2399:x1875064662399616:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788201474.606281:0:18746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.606306:0:18746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 8 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.606317:0:18746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201474.606322:0:18746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201474.606328:0:18746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.606372:0:18746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 8 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.606387:0:18746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 8 pid: 18747 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201474.606402:0:18746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18746:1875064681347712:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201474.606966:0:18746:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201474.608682:0:18746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18746:1875064681347712:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201474.608719:0:18746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201474.610951:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201474.612802:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662399744 00000100:00100000:1.0:1788201474.612820:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662399744 00010000:00010000:1.0:1788201474.612885:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 9 pid: 18747 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201474.612944:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:1.0:1788201474.612955:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02286e61-118a-46f7-9134-2c74a0c116ce+9:2398:x1875064662399744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201474.612973:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201474.612999:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 9 pid: 18747 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.613037:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 9 pid: 18747 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.613068:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee44721b6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc597 expref: 9 pid: 18747 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.613091:0:17225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201474.613096:0:17225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201474.613103:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.613114:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.613161:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201474.613245:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02286e61-118a-46f7-9134-2c74a0c116ce+8:2398:x1875064662399744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 290us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201474.613254:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00010000:00010000:0.0:1788201474.613351:0:18746:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.613361:0:18746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.613386:0:18746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.613395:0:18746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.613402:0:18746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.613419:0:18746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201474.613423:0:18746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.613431:0:18746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.613445:0:18746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.613452:0:18746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e440f360/0xf9b71aee44721b74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201474.613510:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+7:2399:x1875064662399616:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 7289us (7535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201474.613518:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:0.0:1788201474.616954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201474.617286:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662400000 00000100:00100000:1.0:1788201474.617298:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662400000 00000100:00100000:1.0:1788201474.617374:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:1.0:1788201474.617388:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+16:15664:x1875064662400000:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788201474.617495:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.617539:0:19574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 16 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.617551:0:19574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.617595:0:19574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 16 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.617611:0:19574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 16 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201474.617629:0:19574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19574:1875064681347840:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201474.617762:0:19574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a0800c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201474.627576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.627663:0:19574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19574:1875064681347840:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201474.627672:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662400128 00000100:00100000:0.0:1788201474.627682:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662400128 00010000:00010000:3.0:1788201474.627704:0:19574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.627736:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 17 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201474.627816:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1788201474.627829:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02286e61-118a-46f7-9134-2c74a0c116ce+17:2399:x1875064662400128:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201474.627849:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201474.627873:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 17 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.628531:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 17 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.628564:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee44721ac5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc558 expref: 17 pid: 17241 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.628584:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:0.0:1788201474.628591:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 16 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.628603:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.628612:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.628621:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.628660:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201474.628786:0:19574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201474.628788:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02286e61-118a-46f7-9134-2c74a0c116ce+16:2399:x1875064662400128:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 909us (1176us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201474.628803:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201474.628808:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00010000:00010000:3.0:1788201474.629088:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.629102:0:19574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 16 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.629112:0:19574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.630237:0:19574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 16 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.630261:0:19574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 16 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201474.630302:0:19574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19574:1875064681347968:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201474.630414:0:19574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201474.634311:0:19574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19574:1875064681347968:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201474.634353:0:19574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201474.635945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.636392:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662400256 00000100:00100000:3.0:1788201474.636405:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662400256 00010000:00010000:3.0:1788201474.636465:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 17 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201474.636521:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201474.636533:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02286e61-118a-46f7-9134-2c74a0c116ce+17:2399:x1875064662400256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201474.636554:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201474.636573:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 17 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.636590:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 17 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.636620:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0e00/0xf9b71aee44721b4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc582 expref: 17 pid: 17242 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.636643:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:3.0:1788201474.636649:0:17227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.636674:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.636683:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.636724:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201474.636779:0:19574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.636788:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201474.636948:0:19574:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934616 00000100:00100000:3.0:1788201474.637022:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02286e61-118a-46f7-9134-2c74a0c116ce+17:2399:x1875064662400256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 490us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201474.637031:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000001:00080000:2.0:1788201474.637079:0:19574:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788201474.637116:0:19574:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788201474.637209:0:19574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19574:1875064681348096:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788201474.637271:0:19574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201474.637316:0:19574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201474.637393:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681348096 00000100:00100000:1.0:1788201474.637398:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681348096 00000100:00100000:1.0:1788201474.637441:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201474.637450:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19574:x1875064681348096:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201474.637534:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19574:x1875064681348096:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201474.637541:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201474.637621:0:19574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19574:1875064681348096:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788201474.637866:0:19574:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788201474.637910:0:19574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19574:1875064681348224:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788201474.637938:0:19574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201474.637961:0:19574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201474.638125:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681348224 00000100:00100000:1.0:1788201474.638130:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681348224 00000100:00100000:1.0:1788201474.638161:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201474.638169:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19574:x1875064681348224:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201474.638304:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:19574:x1875064681348224:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (364us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788201474.638311:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201474.638335:0:19574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19574:1875064681348224:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788201474.638370:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638380:0:19574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638388:0:19574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638394:0:19574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201474.638399:0:19574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638406:0:19574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638421:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:3.0:1788201474.638425:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201474.638450:0:19574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638457:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b82 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638493:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638500:0:19574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638516:0:19574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638521:0:19574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201474.638524:0:19574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638530:0:19574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638539:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:3.0:1788201474.638541:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201474.638549:0:19574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 19 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638559:0:19574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 19 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638580:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 19 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.638780:0:19574:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 19 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201474.638793:0:19574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19574:1875064681348352:192.168.203.2@tcp:105: 00000100:00100000:3.0:1788201474.638861:0:19574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8200a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201474.643654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201474.643794:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662400384 00000100:00100000:2.0:1788201474.643806:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662400384 00000100:00100000:2.0:1788201474.643869:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1788201474.643881:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf810c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+20:15663:x1875064662400384:12345-192.168.203.2@tcp:49:dd.0 00000100:00100000:3.0:1788201474.643997:0:19574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19574:1875064681348352:192.168.203.2@tcp:105: 00000100:00100000:2.0:1788201474.644043:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf810c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+20:15663:x1875064662400384:12345-192.168.203.2@tcp:49:dd.0 Request processed in 164us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201474.644052:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00010000:00010000:3.0:1788201474.644100:0:19574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644113:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0200/0xf9b71aee44721ada lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644218:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644236:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644250:0:19574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644261:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644268:0:19574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644276:0:19574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644347:0:19574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75a00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201474.644352:0:19574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644362:0:19574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644376:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:3.0:1788201474.644379:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201474.644382:0:19574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644388:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75a00/0xf9b71aee44721b89 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644400:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644406:0:19574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644412:0:19574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644417:0:19574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255e00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201474.644420:0:19574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644426:0:19574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644551:0:19574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:3.0:1788201474.644554:0:19574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201474.644558:0:19574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.644564:0:19574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255e00/0xf9b71aee44721b7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19574 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201474.644887:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+19:15664:x1875064662400000:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 27500us (27946us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788201474.644896:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000020:00080000:3.0:1788201474.644902:0:19574:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788201474.647068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.647140:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662400512 00000100:00100000:3.0:1788201474.647151:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662400512 00000100:00100000:3.0:1788201474.647220:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:3.0:1788201474.647232:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+19:15663:x1875064662400512:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:3.0:1788201474.647259:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201474.647281:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc59e expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.647324:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74400/0xf9b71aee44721b97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.647340:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74400/0xf9b71aee44721b97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.647353:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74400/0xf9b71aee44721b97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.647522:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44721b90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc59e expref: 21 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.647542:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74400/0xf9b71aee44721b97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc59e expref: 20 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.647551:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:3.0:1788201474.647554:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201474.647557:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74400, rc 0) 00000040:00080000:2.0:1788201474.647660:0:17275:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788201474.647666:0:17275:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201474.647689:0:17275:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788201474.647695:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788201474.647726:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+20:15663:x1875064662400512:12345-192.168.203.2@tcp:101:dd.0 Request processed in 496us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201474.647734:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:0.0:1788201474.648573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201474.648765:0:20381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662400768 00000100:00100000:2.0:1788201474.648782:0:20381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662400768 00000100:00100000:2.0:1788201474.648835:0:20381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:2.0:1788201474.648844:0:20381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02286e61-118a-46f7-9134-2c74a0c116ce+20:15664:x1875064662400768:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788201474.649309:0:20381:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788201474.649351:0:20381:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788201474.649388:0:20381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.649409:0:20381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.649422:0:20381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.649432:0:20381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.649516:0:20381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.649524:0:20381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.649550:0:20381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201474.649671:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201474.649679:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.649688:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afe00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201474.649693:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.649701:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.649716:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:1.0:1788201474.649718:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201474.649724:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.649731:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afe00/0xf9b71aee44721b9e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 20381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201474.649781:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201474.649783:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201474.649785:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201474.649885:0:20381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02286e61-118a-46f7-9134-2c74a0c116ce+22:15664:x1875064662400768:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 1038us (1313us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788201474.649895:0:20381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000020:00080000:2.0:1788201474.649903:0:20381:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201474.815510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201474.815576:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201474.815690:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662401024 00000100:00100000:3.0:1788201474.815703:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662401024 00000100:00100000:3.0:1788201474.815833:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662400896 00000100:00100000:3.0:1788201474.815837:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662400896 00000100:00100000:3.0:1788201474.815860:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1788201474.815870:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:02286e61-118a-46f7-9134-2c74a0c116ce+8:2401:x1875064662401024:12345-192.168.203.2@tcp:4:dd.0 00002000:00010000:3.0:1788201474.815933:0:18751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a95ca01, atime: 0x6a95ca00, ctime: 0x6a95ca01, blocks: 0x0 00010000:00010000:3.0:1788201474.815945:0:18751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.815965:0:18751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788201474.815970:0:18751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201474.815977:0:18751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201474.816018:0:18751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201474.882491:0:19559:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1788201474.882523:0:19559:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1788201474.882830:0:18751:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788201474.882836:0:18751:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788201473 -> 1788201474 00002000:00010000:0.0:1788201474.882839:0:18751:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788201473 -> 1788201474 00002000:00010000:0.0:1788201474.882848:0:18751:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1788201474.882870:0:18751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.882892:0:18751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.882903:0:18751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.882912:0:18751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201474.882918:0:18751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.882928:0:18751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.882950:0:18751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.882958:0:18751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44721ba5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201474.883110:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:02286e61-118a-46f7-9134-2c74a0c116ce+6:2401:x1875064662401024:12345-192.168.203.2@tcp:4:dd.0 Request processed in 67235us (67609us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788201474.883142:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:0.0:1788201474.883183:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1788201474.883205:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:02286e61-118a-46f7-9134-2c74a0c116ce+5:2401:x1875064662400896:12345-192.168.203.2@tcp:4:dd.0 00002000:00010000:0.0:1788201474.883272:0:18751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a95ca02, atime: 0x6a95ca00, ctime: 0x6a95ca02, blocks: 0x1a68 00010000:00010000:0.0:1788201474.883281:0:18751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.883294:0:18751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=555s v=(0 0) 00010000:00010000:0.0:1788201474.883299:0:18751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201474.883307:0:18751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.883320:0:18751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201474.934494:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201474.945815:0:19559:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788201474.946081:0:18751:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788201474.946107:0:18751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.946123:0:18751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.946145:0:18751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.946153:0:18751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201474.946159:0:18751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.946169:0:18751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.946195:0:18751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201474.946204:0:18751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44721bac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201474.946395:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:02286e61-118a-46f7-9134-2c74a0c116ce+5:2401:x1875064662400896:12345-192.168.203.2@tcp:4:dd.0 Request processed in 63188us (130810us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788201474.946414:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00010000:00010000:0.0:1788201475.958144:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201476.374951:0:20419:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788201476.726101:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201476.726143:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681348480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201476.726237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201476.726362:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681348480 00000100:00100000:1.0:1788201476.726373:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681348480 00000100:00100000:1.0:1788201476.726456:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201476.726466:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681348480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201476.726513:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201476.726581:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681348480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201476.726589:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201476.726640:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681348480:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788201476.726826:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201476.982490:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201477.238261:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681348736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.238364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.238411:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681349248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.238441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.238465:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681349760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.238512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.238543:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201477.238686:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681348736 00000100:00100000:0.0:1788201477.238695:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681348736 00000100:00100000:0.0:1788201477.238787:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788201477.238798:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681348736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201477.238856:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681348736:12345-0@lo:400:kworker.0 Request processed in 61us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.238863:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788201477.238895:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201477.238911:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681350272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201477.238942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201477.238972:0:20379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681350272 00000100:00100000:0.0:1788201477.238976:0:20379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681350272 00000100:00100000:0.0:1788201477.239016:0:20379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201477.239022:0:20379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681350272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201477.239050:0:20379:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788201477.239087:0:20379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681350272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.239093:0:20379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788201477.239109:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201477.239147:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681350272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201477.239184:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681349248 00000100:00100000:0.0:1788201477.239188:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681349248 00000100:00100000:0.0:1788201477.239214:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681349760 00000100:00100000:0.0:1788201477.239217:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681349760 00000100:00100000:0.0:1788201477.239241:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201477.239248:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681349248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201477.239281:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681349248:12345-0@lo:400:kworker.0 Request processed in 34us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.239287:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201477.239298:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201477.239305:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681349760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201477.239331:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681349760:12345-0@lo:400:kworker.0 Request processed in 27us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.239336:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788201477.239354:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201477.239886:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681348992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.239930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.240673:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681348864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.240697:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681349504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.240713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201477.240717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201477.240735:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681350016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.240735:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681349376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.240781:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.240798:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681349888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.240821:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.240855:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681348736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.240871:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681349248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.240882:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681349760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.240935:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681348864 00000100:00100000:2.0:1788201477.240941:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681348864 00000100:00100000:2.0:1788201477.240976:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681349376 00000100:00100000:2.0:1788201477.240978:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681349376 00000100:00100000:2.0:1788201477.240993:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201477.241000:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681348864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241055:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681348864:12345-0@lo:400:kworker.0 Request processed in 54us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.241062:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201477.241078:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201477.241084:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681349376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241111:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681349376:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.241116:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201477.241155:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681349888 00000100:00100000:2.0:1788201477.241159:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681349888 00000100:00100000:2.0:1788201477.241192:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201477.241199:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681349888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241230:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681349888:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.241236:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788201477.241252:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201477.241273:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681348864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241283:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681349376:0@lo:400:kworker.0 00010000:00080000:2.0:1788201477.241294:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf697480 x1875064681349888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201477.241305:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681349888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241353:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681348992 00000100:00100000:2.0:1788201477.241357:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681348992 00000100:00100000:2.0:1788201477.241388:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681349504 00000100:00100000:2.0:1788201477.241391:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681349504 00000100:00100000:2.0:1788201477.241408:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201477.241414:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681348992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.241428:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.241447:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681348992:12345-0@lo:400:kworker.0 Request processed in 34us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.241453:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201477.241459:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681348992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241464:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201477.241469:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788201477.241469:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681349504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.241477:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681348608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201477.241495:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681349504:12345-0@lo:400:kworker.0 Request processed in 26us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201477.241499:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.241510:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201477.241518:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681349120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241529:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681350016 00000100:00100000:2.0:1788201477.241532:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681350016 00000100:00100000:3.0:1788201477.241537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.241565:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201477.241571:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681350016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241606:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681350016:12345-0@lo:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.241612:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201477.241615:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681349632:0@lo:400:kworker.0 00000100:00080000:2.0:1788201477.241625:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201477.241629:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201477.241637:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.241638:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681349120 00000100:00100000:2.0:1788201477.241641:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681349120 00000100:00100000:3.0:1788201477.241653:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681350144:0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.241665:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201477.241670:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681349120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.241674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201477.241871:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce09e1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681350400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201477.241943:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681349120:12345-0@lo:400:kworker.0 Request processed in 272us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.241951:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201477.241974:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681348608 00000100:00100000:2.0:1788201477.241978:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681348608 00000100:00100000:2.0:1788201477.242002:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201477.242009:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681348608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201477.242024:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788201477.242057:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681348608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.242063:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201477.242078:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681349632 00000100:00100000:2.0:1788201477.242081:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681349632 00000100:00100000:2.0:1788201477.242103:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681350144 00000100:00100000:2.0:1788201477.242106:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681350144 00000100:00100000:2.0:1788201477.242121:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201477.242126:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681349632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.242158:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681349632:12345-0@lo:400:kworker.0 Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.242163:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201477.242174:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201477.242180:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681350144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201477.242206:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681350144:12345-0@lo:400:kworker.0 Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.242212:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788201477.242233:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201477.242237:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201477.242251:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681350656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201477.242277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.242297:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201477.242303:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681350528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201477.242326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.242349:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681350528 00000100:00100000:2.0:1788201477.242353:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681350528 00000100:00100000:2.0:1788201477.242373:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201477.242379:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681350528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201477.242408:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201477.242441:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681350528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.242447:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201477.242473:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681350656 00000100:00100000:2.0:1788201477.242476:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681350656 00000100:00100000:2.0:1788201477.242495:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201477.242501:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681350656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201477.242512:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788201477.242541:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681350656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201477.242547:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201477.242581:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681350528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201477.242594:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681350656:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788201477.243078:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf694380 x1875064681350144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201477.243105:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681350144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.243121:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681349504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.243131:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681350016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.243318:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788201477.243324:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ce09e1c4a80, transno 8589934596 00000004:00080000:3.0:1788201477.243338:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788201477.243361:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681348608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201477.243373:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681349120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201477.243384:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681349632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201477.248336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201477.255853:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681350400 00000100:00100000:0.0:1788201477.255874:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681350400 00000100:00100000:0.0:1788201477.255964:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201477.255978:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681350400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201477.256028:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788201477.256138:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681350400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (7812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.256146:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201477.256457:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce09e1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681350400:0@lo:41:osp-pre-0-1.0 Debug log: 42311 lines, 42311 kept, 0 dropped, 0 bad.